Apr 21 20:47:19 devstack cinder-volume[72689]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:47:19 devstack cinder-volume[72689]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:47:19 devstack cinder-volume[72689]: we strongly recommend against using it for new projects. Apr 21 20:47:19 devstack cinder-volume[72689]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:47:19 devstack cinder-volume[72689]: framework. For more detail see Apr 21 20:47:19 devstack cinder-volume[72689]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:47:19 devstack cinder-volume[72689]: import eventlet # noqa Apr 21 20:47:21 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:47:21 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:47:21 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:47:22 devstack cinder-volume[72689]: INFO dbcounter [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Registered counter for database cinder Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG dbcounter [-] [72689] Writer thread running {{(pid=72689) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:47:22 devstack cinder-volume[72689]: INFO cinder.rpc [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:47:22 devstack cinder-volume[72689]: INFO cinder.rpc [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:47:22 devstack cinder-volume[72689]: INFO cinder.volume.manager [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Determined volume DB was empty at startup. Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG cinder.volume.manager [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72689) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:47:22 devstack cinder-volume[72689]: INFO cinder.volume.manager [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:47:22 devstack cinder-volume[72689]: WARNING stevedore.named [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:47:22 devstack cinder-volume[72689]: WARNING castellan.key_manager [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:47:22 devstack cinder-volume[72689]: WARNING cinder.keymgr.conf_key_mgr [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG cinder.volume.drivers.lvm [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72689) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_concurrency.processutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72689) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_concurrency.processutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.234s {{(pid=72689) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:47:22 devstack cinder-volume[72689]: INFO cinder.rpc [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 21 20:47:22 devstack cinder-volume[72689]: INFO cinder.rpc [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 21 20:47:22 devstack cinder-volume[72689]: WARNING stevedore.named [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:47:22 devstack cinder-volume[72689]: WARNING castellan.key_manager [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:47:22 devstack cinder-volume[72689]: INFO cinder.volume.manager [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_db.sqlalchemy.engines [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:47:22 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Starting 1 workers Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Started child 72797 {{(pid=72689) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Full set of CONF: {{(pid=72689) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] ******************************************************************************** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Configuration options gathered from: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] ================================================================================ {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] allow_availability_zone_fallback = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] allow_compression_on_image_upload = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] allowed_direct_url_schemes = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] api_rate_limit = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72797]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] auth_strategy = keystone {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] az_cache_duration = 3600 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_host = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_stats_polling_interval = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backup_api_class = cinder.backup.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backup_name_template = backup-%s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backup_use_same_host = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backup_use_temp_snapshot = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] chap_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] chap_username = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_internal_tenant_project_id = 4ac8dc04b6524f5f853463ce299867dd {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_internal_tenant_user_id = 8f9f7afd203542a9999300a69a52bd17 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cloned_volume_same_az = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cluster = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] compression_format = gzip {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] compute_api_class = cinder.compute.nova.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] config_dir = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] config_source = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] control_exchange = openstack {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] debug = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] default_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] default_group_type = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] default_volume_type = lvmdriver-1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] disk_geometry = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] driver_client_cert = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] driver_client_cert_key = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] driver_data_namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] driver_ssl_cert_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] driver_ssl_cert_verify = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] driver_use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] enable_force_upload = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] enable_new_services = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] enable_unsupported_driver = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] enforce_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] filter_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_api_insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_api_ssl_compression = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_ca_certificates_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_catalog_info = image:glance:publicURL {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_num_retries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance_request_timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] goodness_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] graceful_shutdown_timeout = 5 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] group_api_class = cinder.group.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] host = devstack {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_compress_on_upload = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_conversion_address_space_limit = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_conversion_cpu_limit = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_conversion_disable = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_upload_use_cinder_backend = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_upload_use_internal_tenant = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_volume_cache_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_volume_cache_max_count = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] image_volume_cache_max_size_gb = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] init_host_max_objects_retrieval = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] instance_format = [instance: %(uuid)s] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] iscsi_target_flags = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] iscsi_write_cache = on {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] iser_helper = tgtadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] iser_ip_address = 192.168.122.213 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] iser_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_color = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_config_append = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_dir = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_options = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_rotate_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_rotate_interval_type = days {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] log_rotation_type = none {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] max_age = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] max_logfile_count = 30 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] max_logfile_size_mb = 200 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] max_over_subscription_ratio = 20.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] message_reap_interval = 86400 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] message_ttl = 2592000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] migration_create_volume_timeout_secs = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] monkey_patch = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] monkey_patch_modules = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] my_ip = 192.168.122.213 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72797]: INFO cinder.volume.manager [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] no_snapshot_gb_quota = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] num_iser_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] num_shell_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] num_volume_device_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] nvmeof_conn_info_version = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] nvmet_ns_id = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] nvmet_port_id = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] osapi_max_limit = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] osapi_volume_ext_list = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] osapi_volume_listen_port = 8776 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] osapi_volume_use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] osapi_volume_workers = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] per_volume_size_limit = -1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] periodic_fuzzy_delay = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] periodic_interval = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] public_endpoint = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] publish_errors = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] quota_backup_gigabytes = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] quota_backups = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] quota_gigabytes = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] quota_groups = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] quota_snapshots = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] quota_volumes = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] rate_limit_burst = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] rate_limit_except_level = CRITICAL {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] rate_limit_interval = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] reinit_driver_count = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] replication_device = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] report_discard_supported = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] report_interval = 120 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] reservation_clean_interval = 86400 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] reservation_expire = 86400 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] reserved_image_namespaces = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] reserved_percentage = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] rpc_response_timeout = 120 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] run_external_periodic_tasks = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] scst_target_driver = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] scst_target_iqn_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_down_time = 720 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] shell_completion = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] snapshot_name_template = snapshot-%s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] snapshot_same_host = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] state_path = /opt/stack/data/cinder {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] storage_availability_zone = nova {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] storage_protocol = iSCSI {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] syslog_log_facility = LOG_USER {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] target_helper = lioadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] target_ip_address = 192.168.122.213 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] target_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] target_protocol = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] target_secondary_ip_addresses = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] trace_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] transport_url = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] until_refresh = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] use_chap_auth = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] use_default_quota_class = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] use_journal = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] use_json = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] use_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] use_stderr = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] use_syslog = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] verify_glance_signatures = enabled {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_api_class = cinder.volume.api.API {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_backend_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_clear = zero {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_clear_ionice = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_clear_size = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_copy_bps_limit = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_dd_blocksize = 1M {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_name_template = volume-%s {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_service_inithost_offload = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volume_usage_audit_period = month {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] zoning_mode = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_concurrency.disable_process_locking = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.admin_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.admin_token = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.admin_user = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_port = 35357 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_protocol = https {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_type = password {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_uri = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.auth_version = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.cache = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.identity_uri = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.include_service_catalog = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.interface = public {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_password = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcache_username = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.region_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.service_type = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.backend = dogpile.cache.null {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.backend_argument = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.backend_expiration_time = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.config_prefix = cache.oslo {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.debug_cache_backend = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.enable_retry_client = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.enable_socket_keepalive = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.enforce_fips_mode = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.expiration_time = 600 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.hashclient_retry_attempts = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.memcache_dead_retry = 300 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.memcache_pool_maxsize = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.memcache_sasl_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.proxies = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.redis_db = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.redis_server = localhost:6379 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.retry_attempts = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.retry_delay = 0.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.socket_keepalive_count = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.socket_keepalive_idle = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.socket_keepalive_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.socket_timeout = 1.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.tls_allowed_ciphers = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.tls_cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.tls_certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.tls_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.tls_keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cache.username = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] coordination.backend_url = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.asyncio_connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.asyncio_slave_connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.backend = sqlalchemy {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.connection_debug = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.connection_parameters = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.connection_recycle_time = 3600 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.connection_trace = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.db_inc_retry_interval = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.db_max_retries = 20 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.db_max_retry_interval = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.db_retry_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.max_overflow = 50 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.max_pool_size = 5 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.max_retries = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.mysql_wsrep_sync_wait = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.pool_timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.retry_interval = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.slave_connection = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.sqlite_synchronous = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.synchronous_reader = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] database.use_db_reconnect = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.connection_string = messaging:// {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.es_doc_type = notification {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.es_scroll_size = 10000 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.es_scroll_time = 2m {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.filter_error_trace = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.hmac_keys = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.sentinel_service_name = mymaster {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.socket_timeout = 0.1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.trace_requests = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler.trace_sqlalchemy = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler_jaeger.process_tags = {} {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler_jaeger.service_name_prefix = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] profiler_otlp.service_name_prefix = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.enforce_new_defaults = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:22 devstack cinder-volume[72689]: WARNING oslo_config.cfg [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.enforce_scope = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.policy_default_rule = default {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.policy_file = policy.yaml {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] privsep_osbrick.group = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] privsep_osbrick.helper_command = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] privsep_osbrick.user = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_sys_admin.group = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_sys_admin.helper_command = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] cinder_sys_admin.user = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.auth_type = password {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.send_service_user_token = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] service_user.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.auth_type = password {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.region_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] glance.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.backend_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.chap_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.chap_username = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.disk_geometry = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.driver_client_cert = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.driver_client_cert_key = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.driver_data_namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.driver_use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.extra_capabilities = {} {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.filter_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.goodness_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.iscsi_target_flags = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.iscsi_write_cache = on {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.iser_helper = tgtadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.iser_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.lvm_share_target = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.lvm_type = auto {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.num_shell_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.replication_device = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.report_discard_supported = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.reserved_percentage = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.target_helper = tgtadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.target_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.target_protocol = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.trace_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.unique_fqdn_network = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.use_chap_auth = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_backend_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_clear = zero {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_clear_ionice = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_clear_size = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_reports.file_event_handler = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_reports.log_dir = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.backend_host = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.chap_password = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.chap_username = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.disk_geometry = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.driver_client_cert = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.extra_capabilities = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.filter_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.goodness_function = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.iser_helper = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.iser_ip_address = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.iser_port = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.lvm_share_target = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.lvm_type = auto {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.num_shell_tries = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.replication_device = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.report_discard_supported = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.reserved_percentage = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.scst_target_driver = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.storage_protocol = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.target_helper = lioadm {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.target_ip_address = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.target_port = 3260 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.trace_flags = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.use_chap_auth = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_clear = zero {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_clear_size = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] lvmdriver-1.volumes_dir = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack sudo[72801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack sudo[72801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_notifications.driver = [] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_notifications.retry = -1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] key_manager.fixed_key = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.barbican_api_version = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.barbican_endpoint = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.barbican_endpoint_type = public {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.barbican_region_name = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.number_of_retries = 60 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.retry_delay = 1 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.send_service_user_token = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.verify_ssl = True {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican.verify_ssl_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.auth_section = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.auth_type = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.cafile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.certfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.collect_timing = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.insecure = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.keyfile = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.split_loggers = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] barbican_service_user.timeout = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.approle_role_id = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.approle_secret_id = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.kv_mountpoint = secret {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.kv_path = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.kv_version = 2 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.namespace = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.root_token_id = **** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.ssl_ca_crt_file = None {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.timeout = 60.0 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.use_ssl = False {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:47:22 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] ******************************************************************************** {{(pid=72689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:47:23 devstack sudo[72801]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:23 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:23 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:23 devstack sudo[72879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:23 devstack sudo[72879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:23 devstack sudo[72879]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:23 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.534s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:23 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:47:23 devstack cinder-volume[72797]: INFO cinder.brick.local_dev.lvm [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 21 20:47:23 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:23 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:23 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:23 devstack sudo[73157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:23 devstack sudo[73157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:24 devstack sudo[73157]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:24 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.553s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:24 devstack cinder-volume[72797]: DEBUG cinder.brick.local_dev.lvm [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72797) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 21 20:47:24 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:24 devstack sudo[73321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:24 devstack sudo[73321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:25 devstack sudo[73321]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.838s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:25 devstack sudo[73435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:25 devstack sudo[73435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:25 devstack sudo[73435]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.526s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:25 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:25 devstack sudo[73493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 21 20:47:25 devstack sudo[73493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:26 devstack sudo[73493]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:26 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.455s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:26 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:26 devstack sudo[73496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:26 devstack sudo[73496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:26 devstack sudo[73496]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:26 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:26 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:26 devstack sudo[73501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:26 devstack sudo[73501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:27 devstack sudo[73501]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:27 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:27 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:27 devstack sudo[73505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:27 devstack sudo[73505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:27 devstack sudo[73505]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:27 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:27 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:27 devstack sudo[73512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:27 devstack sudo[73512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:28 devstack sudo[73512]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.474s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:28 devstack sudo[73516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:28 devstack sudo[73516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:28 devstack sudo[73516]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.570s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:28 devstack cinder-volume[72797]: INFO cinder.volume.drivers.lvm [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:28 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:28 devstack sudo[73635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:28 devstack sudo[73635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:29 devstack sudo[73635]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:29 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:29 devstack cinder-volume[72797]: DEBUG cinder.volume.drivers.lvm [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Updating volume stats {{(pid=72797) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:47:29 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:29 devstack sudo[73686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:29 devstack sudo[73686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:29 devstack sudo[73686]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:29 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:29 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:29 devstack sudo[73780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:29 devstack sudo[73780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:30 devstack sudo[73780]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:30 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:30 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:30 devstack sudo[73783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:30 devstack sudo[73783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:30 devstack sudo[73783]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:30 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:30 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:30 devstack sudo[73786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:30 devstack sudo[73786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:31 devstack sudo[73786]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:31 devstack cinder-volume[72797]: INFO cinder.volume.driver [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG cinder.volume.driver [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72797) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG oslo_db.sqlalchemy.engines [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG dbcounter [-] [72797] Writer thread running {{(pid=72797) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG cinder.db.sqlalchemy.api [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Building query based on filter {{(pid=72797) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG cinder.image.image_utils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72797) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:47:31 devstack cinder-volume[72797]: INFO cinder.keymgr.migration [None req-cbcd4a65-50dc-435c-9c03-87d77efff23e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG cinder.volume.drivers.lvm [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Updating volume stats {{(pid=72797) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:31 devstack sudo[73791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:31 devstack sudo[73791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:31 devstack sudo[73791]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:31 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:31 devstack sudo[73797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:31 devstack sudo[73797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:32 devstack sudo[73797]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:32 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:32 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:32 devstack sudo[73802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:32 devstack sudo[73802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:32 devstack cinder-volume[72689]: DEBUG dbcounter [-] [72689] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72689) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:47:32 devstack sudo[73802]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:32 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.421s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:32 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:32 devstack sudo[73809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:32 devstack sudo[73809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:33 devstack sudo[73809]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG cinder.manager [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Notifying Schedulers of capabilities ... {{(pid=72797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:47:33 devstack cinder-volume[72797]: INFO cinder.volume.manager [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Driver initialization completed successfully. Apr 21 20:47:33 devstack cinder-volume[72797]: INFO cinder.manager [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Initiating service 2 cleanup Apr 21 20:47:33 devstack cinder-volume[72797]: INFO cinder.manager [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Service 2 cleanup completed. Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG cinder.service [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Creating RPC server for service cinder-volume {{(pid=72797) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG cinder.service [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72797) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:47:33 devstack cinder-volume[72797]: INFO cinder.volume.manager [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG cinder.volume.drivers.lvm [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Updating volume stats {{(pid=72797) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:33 devstack sudo[73813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:33 devstack sudo[73813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:33 devstack sudo[73813]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:33 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:33 devstack sudo[73870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:33 devstack sudo[73870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:34 devstack sudo[73870]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:34 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:34 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:34 devstack sudo[73877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:34 devstack sudo[73877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:34 devstack sudo[73877]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:34 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:34 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:34 devstack sudo[73880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:34 devstack sudo[73880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:35 devstack sudo[73880]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:35 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:35 devstack cinder-volume[72797]: INFO cinder.volume.manager [None req-5fbc933c-263e-4d64-9b05-3a29239e7d98 None None] Driver post RPC initialization completed successfully. Apr 21 20:47:43 devstack cinder-volume[72797]: DEBUG dbcounter [-] [72797] Writing DB stats cinder:SELECT=3 {{(pid=72797) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:47:45 devstack cinder-volume[72797]: DEBUG dbcounter [-] [72797] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72797) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:48:49 devstack cinder-volume[72797]: DEBUG oslo_service.periodic_task [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72797) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:48:49 devstack cinder-volume[72797]: DEBUG cinder.volume.drivers.lvm [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Updating volume stats {{(pid=72797) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:48:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:49 devstack sudo[78665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:49 devstack sudo[78665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:49 devstack sudo[78665]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:49 devstack sudo[78669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:49 devstack sudo[78669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:49 devstack sudo[78669]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:49 devstack sudo[78679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:49 devstack sudo[78679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:50 devstack sudo[78679]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:50 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:50 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:50 devstack sudo[78723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:50 devstack sudo[78723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:50 devstack sudo[78723]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:50 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:50 devstack cinder-volume[72797]: DEBUG cinder.manager [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Notifying Schedulers of capabilities ... {{(pid=72797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:49:45 devstack cinder-volume[72797]: DEBUG dbcounter [-] [72797] Writing DB stats cinder:SELECT=1 {{(pid=72797) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:45 devstack cinder-volume[72797]: DEBUG dbcounter [-] [72797] Writing DB stats cinder:UPDATE=1 {{(pid=72797) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:49 devstack cinder-volume[72797]: DEBUG oslo_service.periodic_task [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72797) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:49:49 devstack cinder-volume[72797]: DEBUG cinder.volume.drivers.lvm [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Updating volume stats {{(pid=72797) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:49:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:49 devstack sudo[80495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:49:49 devstack sudo[80495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:49 devstack sudo[80495]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:49 devstack sudo[80509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:49 devstack sudo[80509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:49 devstack sudo[80509]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:49 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:49 devstack sudo[80527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:49:49 devstack sudo[80527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:50 devstack sudo[80527]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:50 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:50 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:50 devstack sudo[80554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:50 devstack sudo[80554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:50 devstack sudo[80554]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:50 devstack cinder-volume[72797]: DEBUG oslo_concurrency.processutils [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72797) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:50 devstack cinder-volume[72797]: DEBUG cinder.manager [None req-fb3c7cbd-869b-42f1-ae78-5ec2d3ef4a34 None None] Notifying Schedulers of capabilities ... {{(pid=72797) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:50:47 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Caught SIGTERM, stopping children Apr 21 20:50:47 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Acquiring lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:47 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Acquired lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:47 devstack cinder-volume[72689]: DEBUG oslo_concurrency.lockutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Releasing lock "singleton_lock" {{(pid=72689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:47 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Stop services. {{(pid=72689) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:50:47 devstack cinder-volume[72689]: DEBUG oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Killing children. {{(pid=72689) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:50:47 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Waiting on 1 children to exit Apr 21 20:50:48 devstack cinder-volume[72797]: DEBUG oslo_concurrency.lockutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Acquiring lock "singleton_lock" {{(pid=72797) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:48 devstack cinder-volume[72797]: DEBUG oslo_concurrency.lockutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Acquired lock "singleton_lock" {{(pid=72797) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:48 devstack cinder-volume[72797]: DEBUG oslo_concurrency.lockutils [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Releasing lock "singleton_lock" {{(pid=72797) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:48 devstack cinder-volume[72797]: WARNING amqp [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:50:48 devstack cinder-volume[72797]: WARNING amqp [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:50:48 devstack cinder-volume[72689]: INFO oslo_service.backend._eventlet.service [None req-42cce38e-4ac8-4d74-84d6-994af6640fb2 None None] Child 72797 exited with status 0 Apr 21 20:50:48 devstack cinder-volume[81839]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:50:48 devstack cinder-volume[81839]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:50:48 devstack cinder-volume[81839]: we strongly recommend against using it for new projects. Apr 21 20:50:48 devstack cinder-volume[81839]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:50:48 devstack cinder-volume[81839]: framework. For more detail see Apr 21 20:50:48 devstack cinder-volume[81839]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:50:48 devstack cinder-volume[81839]: import eventlet # noqa Apr 21 20:50:50 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:50:50 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:50:50 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:50:51 devstack cinder-volume[81839]: INFO dbcounter [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Registered counter for database cinder Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_db.sqlalchemy.engines [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG dbcounter [-] [81839] Writer thread running {{(pid=81839) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:50:51 devstack cinder-volume[81839]: INFO cinder.rpc [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:50:51 devstack cinder-volume[81839]: INFO cinder.rpc [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_db.sqlalchemy.engines [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:51 devstack cinder-volume[81839]: INFO cinder.volume.manager [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Determined volume DB was empty at startup. Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG cinder.volume.manager [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81839) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:50:51 devstack cinder-volume[81839]: INFO cinder.volume.manager [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:50:51 devstack cinder-volume[81839]: WARNING stevedore.named [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:50:51 devstack cinder-volume[81839]: WARNING castellan.key_manager [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:50:51 devstack cinder-volume[81839]: WARNING cinder.keymgr.conf_key_mgr [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:50:51 devstack cinder-volume[81839]: INFO cinder.volume.manager [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_db.sqlalchemy.engines [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81839) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:51 devstack cinder-volume[81839]: INFO oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Starting 1 workers Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Started child 81959 {{(pid=81839) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Full set of CONF: {{(pid=81839) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] ******************************************************************************** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Configuration options gathered from: {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] ================================================================================ {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] allow_availability_zone_fallback = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] allow_compression_on_image_upload = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] allowed_direct_url_schemes = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] api_rate_limit = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] auth_strategy = keystone {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_availability_zone = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81959]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_host = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_stats_polling_interval = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backup_api_class = cinder.backup.api.API {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backup_name_template = backup-%s {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backup_use_same_host = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backup_use_temp_snapshot = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] chap_password = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] chap_username = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_internal_tenant_project_id = 4ac8dc04b6524f5f853463ce299867dd {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_internal_tenant_user_id = 8f9f7afd203542a9999300a69a52bd17 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cluster = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] compression_format = gzip {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] compute_api_class = cinder.compute.nova.API {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] config_dir = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] config_source = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] control_exchange = openstack {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] debug = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] default_availability_zone = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] default_group_type = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] default_volume_type = QuobyteHD {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] disk_geometry = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] driver_client_cert = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] driver_client_cert_key = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] driver_data_namespace = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] driver_ssl_cert_path = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] driver_ssl_cert_verify = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] driver_use_ssl = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] enable_new_services = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] enable_unsupported_driver = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] enabled_backends = ['QuobyteHD'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] enforce_multipath_for_image_xfer = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] filter_function = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_api_insecure = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_api_ssl_compression = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_ca_certificates_file = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_catalog_info = image:glance:publicURL {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_num_retries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance_request_timeout = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] goodness_function = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] graceful_shutdown_timeout = 5 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] group_api_class = cinder.group.api.API {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] host = devstack {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_compress_on_upload = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_conversion_address_space_limit = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_conversion_cpu_limit = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_conversion_disable = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_upload_use_cinder_backend = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_upload_use_internal_tenant = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_volume_cache_enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_volume_cache_max_count = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] image_volume_cache_max_size_gb = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] init_host_max_objects_retrieval = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] instance_format = [instance: %(uuid)s] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] iscsi_target_flags = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] iscsi_write_cache = on {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] iser_helper = tgtadm {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] iser_ip_address = 192.168.122.213 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] iser_port = 3260 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_color = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_config_append = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_dir = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_file = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_options = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_rotate_interval = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_rotate_interval_type = days {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] log_rotation_type = none {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] max_age = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] max_logfile_count = 30 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] max_logfile_size_mb = 200 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] max_over_subscription_ratio = 20.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] message_reap_interval = 86400 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] message_ttl = 2592000 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] migration_create_volume_timeout_secs = 300 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] monkey_patch = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] monkey_patch_modules = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] my_ip = 192.168.122.213 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] no_snapshot_gb_quota = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] num_iser_scan_tries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] num_shell_tries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] num_volume_device_scan_tries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] nvmeof_conn_info_version = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] nvmet_ns_id = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] nvmet_port_id = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] osapi_max_limit = 1000 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] osapi_volume_ext_list = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] osapi_volume_listen = 0.0.0.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] osapi_volume_listen_port = 8776 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] osapi_volume_use_ssl = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] osapi_volume_workers = 2 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] per_volume_size_limit = -1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] periodic_fuzzy_delay = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] periodic_interval = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] project_id_regex = [0-9a-f\-]+ {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] public_endpoint = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] publish_errors = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] quota_backup_gigabytes = 1000 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] quota_backups = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] quota_gigabytes = 1000 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] quota_groups = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] quota_snapshots = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] quota_volumes = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] rate_limit_burst = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] rate_limit_except_level = CRITICAL {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] rate_limit_interval = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] reinit_driver_count = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] replication_device = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] report_discard_supported = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] report_interval = 120 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] reservation_clean_interval = 86400 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] reservation_expire = 86400 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] reserved_image_namespaces = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] reserved_percentage = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81959]: INFO cinder.volume.manager [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] rpc_response_timeout = 120 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] run_external_periodic_tasks = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] scst_target_driver = iscsi {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] scst_target_iqn_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.remotefs [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81959) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_down_time = 720 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] shell_completion = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] snapshot_name_template = snapshot-%s {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] split_loggers = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] state_path = /opt/stack/data/cinder {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] storage_availability_zone = nova {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] storage_protocol = iSCSI {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] syslog_log_facility = LOG_USER {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] target_helper = lioadm {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] target_ip_address = 192.168.122.213 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] target_port = 3260 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] target_protocol = iscsi {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] target_secondary_ip_addresses = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] trace_flags = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] transfer_api_class = cinder.transfer.api.API {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] transport_url = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] until_refresh = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] use_chap_auth = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] use_default_quota_class = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] use_journal = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] use_json = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] use_multipath_for_image_xfer = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] use_stderr = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] use_syslog = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] verify_glance_signatures = enabled {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_api_class = cinder.volume.api.API {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_backend_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_clear = zero {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_clear_ionice = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_clear_size = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_copy_bps_limit = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_dd_blocksize = 1M {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_name_template = volume-%s {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_service_inithost_offload = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volume_usage_audit_period = month {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] zoning_mode = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_concurrency.disable_process_locking = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.admin_password = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.admin_token = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.admin_user = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_admin_prefix = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_port = 35357 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_protocol = https {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_section = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_type = password {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_uri = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.auth_version = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.cache = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.delay_auth_decision = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.http_connect_timeout = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.identity_uri = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.include_service_catalog = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.insecure = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.interface = public {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_password = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcache_username = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.region_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.service_token_roles_required = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.service_type = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.token_cache_time = 300 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.backend = dogpile.cache.null {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.backend_argument = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.backend_expiration_time = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.config_prefix = cache.oslo {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.debug_cache_backend = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.enable_retry_client = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.enable_socket_keepalive = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.enforce_fips_mode = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.expiration_time = 600 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.hashclient_retry_attempts = 2 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.memcache_dead_retry = 300 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.memcache_pool_maxsize = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.memcache_sasl_enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.password = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.proxies = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.redis_db = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.redis_sentinel_service_name = mymaster {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.redis_server = localhost:6379 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.retry_attempts = 2 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.retry_delay = 0.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.socket_keepalive_count = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.socket_keepalive_idle = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.socket_keepalive_interval = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.socket_timeout = 1.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.tls_allowed_ciphers = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.tls_cafile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.tls_certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.tls_enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.tls_keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cache.username = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] coordination.backend_url = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.asyncio_connection = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.asyncio_slave_connection = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.backend = sqlalchemy {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.connection = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.connection_debug = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.connection_parameters = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.connection_recycle_time = 3600 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.connection_trace = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.db_inc_retry_interval = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.db_max_retries = 20 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.db_max_retry_interval = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.db_retry_interval = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.max_overflow = 50 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.max_pool_size = 5 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.max_retries = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.mysql_wsrep_sync_wait = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.pool_timeout = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.retry_interval = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.slave_connection = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.sqlite_synchronous = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.synchronous_reader = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] database.use_db_reconnect = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.connection_string = messaging:// {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.es_doc_type = notification {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.es_scroll_size = 10000 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.es_scroll_time = 2m {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.filter_error_trace = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.hmac_keys = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.sentinel_service_name = mymaster {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.socket_timeout = 0.1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.trace_requests = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler.trace_sqlalchemy = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler_jaeger.process_tags = {} {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler_jaeger.service_name_prefix = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] profiler_otlp.service_name_prefix = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.enforce_new_defaults = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: WARNING oslo_config.cfg [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.enforce_scope = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.policy_default_rule = default {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.policy_file = policy.yaml {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_policy.remote_timeout = 60.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] privsep_osbrick.group = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] privsep_osbrick.helper_command = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] privsep_osbrick.user = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_sys_admin.group = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_sys_admin.helper_command = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] cinder_sys_admin.user = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.auth_section = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.auth_type = password {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.cafile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.collect_timing = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.insecure = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.send_service_user_token = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.split_loggers = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] service_user.timeout = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.auth_section = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.auth_type = password {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.collect_timing = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.insecure = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.region_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.split_loggers = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] glance.timeout = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.backend_availability_zone = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.chap_password = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.chap_username = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.disk_geometry = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.driver_client_cert = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.driver_client_cert_key = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.driver_data_namespace = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.driver_use_ssl = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.enable_unsupported_driver = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.extra_capabilities = {} {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.filter_function = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.goodness_function = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.iscsi_target_flags = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.iscsi_write_cache = on {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.iser_helper = tgtadm {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.iser_port = 3260 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_host = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_login = admin {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_mount_options = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_password = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_private_key = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_share_path = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_ssh_port = 22 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.num_shell_tries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.nvmet_port_id = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.quobyte_client_cfg = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.quobyte_volume_url = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.replication_device = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.report_discard_supported = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.reserved_percentage = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.scst_target_driver = iscsi {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.scst_target_iqn_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.storage_protocol = iSCSI {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.target_helper = tgtadm {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81959) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81959]: WARNING cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.target_port = 3260 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81959]: WARNING cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.target_protocol = iscsi {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.trace_flags = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.unique_fqdn_network = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.use_chap_auth = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_backend_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_clear = zero {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_clear_ionice = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_clear_size = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Running cmd (subprocess): mount.quobyte {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_reports.file_event_handler = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_reports.log_dir = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.backend_availability_zone = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.backend_host = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.chap_password = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.chap_username = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.chiscsi_conf = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.disk_geometry = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.driver_client_cert = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.driver_client_cert_key = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.driver_data_namespace = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.driver_use_ssl = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.extra_capabilities = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.filter_function = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.goodness_function = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.iscsi_target_flags = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.iscsi_write_cache = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.iser_helper = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.iser_ip_address = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.iser_port = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.iser_target_prefix = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_host = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_login = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_mount_options = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_password = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_private_key = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_share_path = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_ssh_port = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.num_shell_tries = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nvmet_ns_id = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.nvmet_port_id = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.replication_device = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.report_discard_supported = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.reserved_percentage = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.scst_target_driver = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.storage_protocol = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.target_helper = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.target_ip_address = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.target_port = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.target_prefix = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.target_protocol = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.trace_flags = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.unique_fqdn_network = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.use_chap_auth = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_clear = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_clear_ionice = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_clear_size = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] QuobyteHD.volumes_dir = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.ssl = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.ssl_version = {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_notifications.driver = [] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_notifications.retry = -1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] oslo_messaging_notifications.transport_url = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] key_manager.fixed_key = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.barbican_api_version = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.barbican_endpoint = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.barbican_endpoint_type = public {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.barbican_region_name = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.cafile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.collect_timing = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.insecure = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.number_of_retries = 60 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.retry_delay = 1 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.send_service_user_token = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.split_loggers = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.timeout = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.verify_ssl = True {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican.verify_ssl_path = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.auth_section = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.auth_type = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.cafile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.certfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.collect_timing = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.insecure = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.keyfile = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.split_loggers = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] barbican_service_user.timeout = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.approle_role_id = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.approle_secret_id = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.kv_mountpoint = secret {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.kv_path = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.kv_version = 2 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.namespace = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.root_token_id = **** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.ssl_ca_crt_file = None {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.timeout = 60.0 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.use_ssl = False {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:50:51 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] ******************************************************************************** {{(pid=81839) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:50:51 devstack quobyte-client[81960]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:50:51 devstack quobyte-client[81960]: Invalid parameters found, error: missing mount point. Apr 21 20:50:51 devstack quobyte-client[81960]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:50:51 devstack quobyte-client[81960]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=81959) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:51 devstack cinder-volume[81959]: INFO cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 ... Apr 21 20:50:51 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 -c /etc/quobyte/client-cinder.cfg {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:51 devstack sudo[81961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 -c /etc/quobyte/client-cinder.cfg Apr 21 20:50:51 devstack sudo[81961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:52 devstack sudo[81961]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.536s {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:52 devstack cinder-volume[81959]: INFO cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 succeeded Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=81959) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.543s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:52 devstack sudo[82030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:50:52 devstack sudo[82030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:52 devstack sudo[82030]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.434s {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:52 devstack cinder-volume[81959]: INFO cinder.volume.driver [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG cinder.volume.driver [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81959) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_db.sqlalchemy.engines [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81959) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG dbcounter [-] [81959] Writer thread running {{(pid=81959) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG cinder.db.sqlalchemy.api [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Building query based on filter {{(pid=81959) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG cinder.image.image_utils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81959) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:50:52 devstack cinder-volume[81959]: INFO cinder.keymgr.migration [None req-d3044832-0b00-4072-ba28-a1643c385f92 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=81959) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=81959) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:52 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:52 devstack sudo[82034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:50:52 devstack sudo[82034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:53 devstack sudo[82034]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.416s {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG cinder.manager [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Notifying Schedulers of capabilities ... {{(pid=81959) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:50:53 devstack cinder-volume[81959]: INFO cinder.volume.manager [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Driver initialization completed successfully. Apr 21 20:50:53 devstack cinder-volume[81959]: INFO cinder.manager [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Initiating service 3 cleanup Apr 21 20:50:53 devstack cinder-volume[81959]: INFO cinder.manager [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Service 3 cleanup completed. Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG cinder.service [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Creating RPC server for service cinder-volume {{(pid=81959) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG cinder.service [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81959) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:50:53 devstack cinder-volume[81959]: INFO cinder.volume.manager [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=81959) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=81959) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:53 devstack sudo[82040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:50:53 devstack sudo[82040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:53 devstack sudo[82040]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:53 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.451s {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:53 devstack cinder-volume[81959]: INFO cinder.volume.manager [None req-019d5cd9-7ed5-40d9-9160-b8febc8521bb None None] Driver post RPC initialization completed successfully. Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=81959) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG cinder.volume.drivers.quobyte [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=81959) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81959) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:56 devstack sudo[82106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:50:56 devstack sudo[82106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:56 devstack sudo[82106]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG oslo_concurrency.processutils [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.374s {{(pid=81959) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:56 devstack cinder-volume[81959]: DEBUG cinder.manager [None req-42f8b524-2887-437b-bc66-5bfab550eb4c None None] Notifying Schedulers of capabilities ... {{(pid=81959) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:00 devstack cinder-volume[81839]: INFO oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Caught SIGTERM, stopping children Apr 21 20:51:00 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Acquiring lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:51:00 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Acquired lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:51:00 devstack cinder-volume[81839]: DEBUG oslo_concurrency.lockutils [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Releasing lock "singleton_lock" {{(pid=81839) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:51:00 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Stop services. {{(pid=81839) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:51:00 devstack cinder-volume[81839]: DEBUG oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Killing children. {{(pid=81839) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:51:00 devstack cinder-volume[81839]: INFO oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Waiting on 1 children to exit Apr 21 20:51:01 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Acquiring lock "singleton_lock" {{(pid=81959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:51:01 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Acquired lock "singleton_lock" {{(pid=81959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:51:01 devstack cinder-volume[81959]: DEBUG oslo_concurrency.lockutils [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Releasing lock "singleton_lock" {{(pid=81959) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:51:01 devstack cinder-volume[81959]: WARNING amqp [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:51:01 devstack cinder-volume[81959]: WARNING amqp [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:51:01 devstack cinder-volume[81839]: INFO oslo_service.backend._eventlet.service [None req-5a34f7a5-4838-4497-aee1-5774f219c54c None None] Child 81959 exited with status 0 Apr 21 20:51:01 devstack cinder-volume[82179]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:51:01 devstack cinder-volume[82179]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:51:01 devstack cinder-volume[82179]: we strongly recommend against using it for new projects. Apr 21 20:51:01 devstack cinder-volume[82179]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:51:01 devstack cinder-volume[82179]: framework. For more detail see Apr 21 20:51:01 devstack cinder-volume[82179]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:51:01 devstack cinder-volume[82179]: import eventlet # noqa Apr 21 20:51:03 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:51:03 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:51:03 devstack cinder-volume[82179]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82179) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:51:04 devstack cinder-volume[82179]: INFO dbcounter [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Registered counter for database cinder Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_db.sqlalchemy.engines [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG dbcounter [-] [82179] Writer thread running {{(pid=82179) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:51:04 devstack cinder-volume[82179]: INFO cinder.rpc [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:51:04 devstack cinder-volume[82179]: INFO cinder.rpc [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_db.sqlalchemy.engines [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:51:04 devstack cinder-volume[82179]: INFO cinder.volume.manager [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Determined volume DB was empty at startup. Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG cinder.volume.manager [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82179) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:51:04 devstack cinder-volume[82179]: WARNING stevedore.named [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:51:04 devstack cinder-volume[82179]: WARNING castellan.key_manager [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:51:04 devstack cinder-volume[82179]: WARNING cinder.keymgr.conf_key_mgr [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:51:04 devstack cinder-volume[82179]: INFO cinder.volume.manager [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_db.sqlalchemy.engines [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:51:04 devstack cinder-volume[82179]: INFO oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Starting 1 workers Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Started child 82362 {{(pid=82179) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Full set of CONF: {{(pid=82179) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] ******************************************************************************** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Configuration options gathered from: {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] ================================================================================ {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] allow_availability_zone_fallback = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] allow_compression_on_image_upload = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] allowed_direct_url_schemes = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] api_rate_limit = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] auth_strategy = keystone {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_availability_zone = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_host = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_stats_polling_interval = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backup_api_class = cinder.backup.api.API {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backup_name_template = backup-%s {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backup_use_same_host = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backup_use_temp_snapshot = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] chap_password = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] chap_username = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_internal_tenant_project_id = 4ac8dc04b6524f5f853463ce299867dd {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_internal_tenant_user_id = 8f9f7afd203542a9999300a69a52bd17 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cluster = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] compression_format = gzip {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] compute_api_class = cinder.compute.nova.API {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] config_dir = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] config_source = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] control_exchange = openstack {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] debug = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] default_availability_zone = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] default_group_type = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] default_volume_type = QuobyteHD {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] disk_geometry = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] driver_client_cert = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] driver_client_cert_key = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] driver_data_namespace = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] driver_ssl_cert_path = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] driver_ssl_cert_verify = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] driver_use_ssl = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] enable_new_services = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] enable_unsupported_driver = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] enabled_backends = ['QuobyteHD'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] enforce_multipath_for_image_xfer = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] filter_function = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82362]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_api_insecure = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_api_ssl_compression = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_ca_certificates_file = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_catalog_info = image:glance:publicURL {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_num_retries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance_request_timeout = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] goodness_function = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] graceful_shutdown_timeout = 5 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] group_api_class = cinder.group.api.API {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] host = devstack {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_compress_on_upload = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_conversion_address_space_limit = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_conversion_cpu_limit = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_conversion_disable = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_upload_use_cinder_backend = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_upload_use_internal_tenant = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_volume_cache_enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_volume_cache_max_count = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] image_volume_cache_max_size_gb = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] init_host_max_objects_retrieval = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] instance_format = [instance: %(uuid)s] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] iscsi_target_flags = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] iscsi_write_cache = on {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] iser_helper = tgtadm {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] iser_ip_address = 192.168.122.213 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] iser_port = 3260 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_color = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_config_append = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_dir = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_file = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_options = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_rotate_interval = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_rotate_interval_type = days {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] log_rotation_type = none {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] max_age = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] max_logfile_count = 30 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] max_logfile_size_mb = 200 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] max_over_subscription_ratio = 20.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] message_reap_interval = 86400 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] message_ttl = 2592000 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] migration_create_volume_timeout_secs = 300 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] monkey_patch = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] monkey_patch_modules = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] my_ip = 192.168.122.213 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] no_snapshot_gb_quota = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] num_iser_scan_tries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] num_shell_tries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:51:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82362) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] num_volume_device_scan_tries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] nvmeof_conn_info_version = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] nvmet_ns_id = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] nvmet_port_id = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] osapi_max_limit = 1000 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] osapi_volume_ext_list = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] osapi_volume_listen_port = 8776 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] osapi_volume_use_ssl = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] osapi_volume_workers = 2 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] per_volume_size_limit = -1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] periodic_fuzzy_delay = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] periodic_interval = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] public_endpoint = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] publish_errors = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] quota_backup_gigabytes = 1000 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] quota_backups = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] quota_gigabytes = 1000 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] quota_groups = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] quota_snapshots = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] quota_volumes = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] rate_limit_burst = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] rate_limit_except_level = CRITICAL {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] rate_limit_interval = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] reinit_driver_count = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] replication_device = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] report_discard_supported = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] report_interval = 120 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] reservation_clean_interval = 86400 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] reservation_expire = 86400 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] reserved_image_namespaces = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] reserved_percentage = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] rpc_response_timeout = 120 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] run_external_periodic_tasks = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] scst_target_driver = iscsi {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] scst_target_iqn_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_down_time = 720 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] shell_completion = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] snapshot_name_template = snapshot-%s {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] split_loggers = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] state_path = /opt/stack/data/cinder {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] storage_availability_zone = nova {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] storage_protocol = iSCSI {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] syslog_log_facility = LOG_USER {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] target_helper = lioadm {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] target_ip_address = 192.168.122.213 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] target_port = 3260 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] target_protocol = iscsi {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] target_secondary_ip_addresses = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] trace_flags = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] transport_url = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] until_refresh = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] use_chap_auth = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] use_default_quota_class = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] use_journal = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] use_json = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] use_multipath_for_image_xfer = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] use_stderr = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] use_syslog = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] verify_glance_signatures = enabled {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_api_class = cinder.volume.api.API {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_backend_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_clear = zero {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_clear_ionice = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_clear_size = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_copy_bps_limit = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_dd_blocksize = 1M {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_name_template = volume-%s {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_service_inithost_offload = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volume_usage_audit_period = month {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] zoning_mode = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_concurrency.disable_process_locking = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.admin_password = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.admin_token = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.admin_user = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_port = 35357 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_protocol = https {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_section = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_type = password {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_uri = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.auth_version = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.cache = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.identity_uri = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.include_service_catalog = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.insecure = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.interface = public {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_password = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcache_username = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.region_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.service_type = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.backend = dogpile.cache.null {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.backend_argument = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.backend_expiration_time = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.config_prefix = cache.oslo {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.debug_cache_backend = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.enable_retry_client = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.enable_socket_keepalive = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.enforce_fips_mode = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.expiration_time = 600 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.hashclient_retry_attempts = 2 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.memcache_dead_retry = 300 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.memcache_pool_maxsize = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.memcache_sasl_enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.password = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.proxies = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.redis_db = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.redis_server = localhost:6379 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.retry_attempts = 2 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.retry_delay = 0.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.socket_keepalive_count = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.socket_keepalive_idle = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.socket_keepalive_interval = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.socket_timeout = 1.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.tls_allowed_ciphers = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.tls_cafile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.tls_certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.tls_enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.tls_keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cache.username = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] coordination.backend_url = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.asyncio_connection = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.asyncio_slave_connection = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.backend = sqlalchemy {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.connection = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.connection_debug = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.connection_parameters = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.connection_recycle_time = 3600 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.connection_trace = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.db_inc_retry_interval = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.db_max_retries = 20 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.db_max_retry_interval = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.db_retry_interval = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.max_overflow = 50 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.max_pool_size = 5 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.max_retries = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.mysql_wsrep_sync_wait = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.pool_timeout = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.retry_interval = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.slave_connection = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.sqlite_synchronous = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.synchronous_reader = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] database.use_db_reconnect = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.connection_string = messaging:// {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.es_doc_type = notification {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.es_scroll_size = 10000 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.es_scroll_time = 2m {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.filter_error_trace = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.hmac_keys = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.sentinel_service_name = mymaster {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.socket_timeout = 0.1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.trace_requests = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler.trace_sqlalchemy = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler_jaeger.process_tags = {} {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler_jaeger.service_name_prefix = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] profiler_otlp.service_name_prefix = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.enforce_new_defaults = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: WARNING oslo_config.cfg [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.enforce_scope = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.policy_default_rule = default {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.policy_file = policy.yaml {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] privsep_osbrick.group = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] privsep_osbrick.helper_command = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] privsep_osbrick.user = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_sys_admin.group = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_sys_admin.helper_command = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] cinder_sys_admin.user = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.auth_section = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.auth_type = password {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.cafile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.collect_timing = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.insecure = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.send_service_user_token = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.split_loggers = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] service_user.timeout = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.auth_section = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.auth_type = password {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.collect_timing = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.insecure = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.region_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.split_loggers = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] glance.timeout = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.backend_availability_zone = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.chap_password = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.chap_username = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.disk_geometry = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.driver_client_cert = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.driver_client_cert_key = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.driver_data_namespace = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.driver_use_ssl = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.extra_capabilities = {} {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.filter_function = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.goodness_function = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.iscsi_target_flags = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.iscsi_write_cache = on {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.iser_helper = tgtadm {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.iser_port = 3260 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_host = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_login = admin {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_mount_options = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_password = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_private_key = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_share_path = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.num_shell_tries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.quobyte_volume_url = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.replication_device = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.report_discard_supported = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.reserved_percentage = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.target_helper = tgtadm {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82362) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:51:04 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:51:04 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.target_port = 3260 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.target_protocol = iscsi {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.trace_flags = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.unique_fqdn_network = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.use_chap_auth = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_backend_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_clear = zero {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_clear_ionice = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_clear_size = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Running cmd (subprocess): mount.quobyte {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_reports.file_event_handler = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_reports.log_dir = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.backend_availability_zone = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.backend_host = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.chap_password = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.chap_username = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.chiscsi_conf = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.disk_geometry = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.driver_client_cert = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.driver_data_namespace = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.driver_use_ssl = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.extra_capabilities = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.filter_function = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.goodness_function = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.iser_helper = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.iser_ip_address = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.iser_port = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.iser_target_prefix = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_host = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_login = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_mount_options = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_password = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_private_key = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_share_path = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_ssh_port = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.num_shell_tries = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.nvmet_port_id = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.replication_device = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.report_discard_supported = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.reserved_percentage = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.scst_target_driver = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.storage_protocol = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.target_helper = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.target_ip_address = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.target_port = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.target_prefix = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.target_protocol = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.trace_flags = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.use_chap_auth = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_clear = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_clear_size = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] QuobyteHD.volumes_dir = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack quobyte-client[82397]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack quobyte-client[82397]: Invalid parameters found, error: missing mount point. Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack quobyte-client[82397]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:04 devstack quobyte-client[82397]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.ssl = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_notifications.driver = [] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_notifications.retry = -1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] key_manager.fixed_key = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.barbican_api_version = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.barbican_endpoint = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.barbican_endpoint_type = public {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.barbican_region_name = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.cafile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.collect_timing = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.insecure = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.number_of_retries = 60 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.retry_delay = 1 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.send_service_user_token = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.split_loggers = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.timeout = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.verify_ssl = True {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican.verify_ssl_path = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.auth_section = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.auth_type = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.cafile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.certfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.collect_timing = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.insecure = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.keyfile = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.split_loggers = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] barbican_service_user.timeout = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.approle_role_id = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.approle_secret_id = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.kv_mountpoint = secret {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.kv_path = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.kv_version = 2 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.namespace = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.root_token_id = **** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.ssl_ca_crt_file = None {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.timeout = 60.0 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.use_ssl = False {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:51:05 devstack cinder-volume[82179]: DEBUG oslo_service.backend._eventlet.service [None req-8438ee90-096c-4644-8df7-6a2c7c2bedc3 None None] ******************************************************************************** {{(pid=82179) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:05 devstack sudo[82406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:51:05 devstack sudo[82406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:05 devstack sudo[82406]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.564s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:05 devstack cinder-volume[82362]: INFO cinder.volume.driver [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG cinder.volume.driver [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82362) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_db.sqlalchemy.engines [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82362) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writer thread running {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG cinder.db.sqlalchemy.api [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Building query based on filter {{(pid=82362) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82362) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:05 devstack cinder-volume[82362]: INFO cinder.keymgr.migration [None req-5c3703db-29c9-4c78-ba2a-f92500b91709 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:51:05 devstack sudo[82425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:51:05 devstack sudo[82425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:06 devstack sudo[82425]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.382s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Driver initialization completed successfully. Apr 21 20:51:06 devstack cinder-volume[82362]: INFO cinder.manager [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Initiating service 3 cleanup Apr 21 20:51:06 devstack cinder-volume[82362]: INFO cinder.manager [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Service 3 cleanup completed. Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG cinder.service [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Creating RPC server for service cinder-volume {{(pid=82362) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG cinder.service [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82362) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:51:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:06 devstack sudo[82431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:51:06 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:06 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.412s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7708605e-7a3b-48bb-a192-0906d14c7e7f None None] Driver post RPC initialization completed successfully. Apr 21 20:51:14 devstack cinder-volume[82179]: DEBUG dbcounter [-] [82179] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82179) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:51:16 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:51:16 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=2 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:05 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Flow 'volume_create_manager' (5150ff80-f14c-406c-9fd9-7f8edac0b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47db49c-5d99-4323-98e2-777fa7c26def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47db49c-5d99-4323-98e2-777fa7c26def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1624186240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa77b116d174a599ca1820bab41a954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:06Z,use_quota=True,user_id='a602982dc8494e50a4bd97f5edc09aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09636fa6-5ccf-4f28-92dd-705a539bddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09636fa6-5ccf-4f28-92dd-705a539bddd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba27af6-c82b-481c-a8f5-6d81c19e43ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba27af6-c82b-481c-a8f5-6d81c19e43ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe', 'volume_name': 'volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8857195f-be84-4816-adcd-603eb6fea123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8857195f-be84-4816-adcd-603eb6fea123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c9b7d8-e47f-4ea6-8cfa-ba7d4dd431c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:06 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Volume ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe', 'volume_size': 1} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1624186240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa77b116d174a599ca1820bab41a954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:06Z,use_quota=True,user_id='a602982dc8494e50a4bd97f5edc09aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Creating volume ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:06 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:52:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:06 devstack sudo[82942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe 1073741824 Apr 21 20:52:06 devstack sudo[82942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:07 devstack sudo[82942]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe 1073741824" returned: 0 in 1.586s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:07 devstack sudo[83267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe Apr 21 20:52:07 devstack sudo[83267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:08 devstack sudo[83267]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe" returned: 0 in 0.941s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.646s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c9b7d8-e47f-4ea6-8cfa-ba7d4dd431c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba2670a-7f5c-490d-abfc-592491b9476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:08 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Volume volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe (ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe): created successfully Apr 21 20:52:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba2670a-7f5c-490d-abfc-592491b9476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Flow 'volume_create_manager' (5150ff80-f14c-406c-9fd9-7f8edac0b675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:08 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a40c998d-16f3-4fb6-a176-9c66f01d5d46 tempest-DeleteServersTestJSON-1202620190 None] Created volume successfully. Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Flow 'volume_create_manager' (4abed288-72a2-48e5-9b45-d58b57d960f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffb851f-a61a-4d95-a725-b319657943d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffb851f-a61a-4d95-a725-b319657943d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1292735914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60597555-6036-4a9f-878a-0c3a93ecfcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ca85f95cc4bb896c551337dd744dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:16Z,use_quota=True,user_id='980022194f754d07bd403f7cce58d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a3f1c5-40f1-4433-8b2f-ce169b941ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a3f1c5-40f1-4433-8b2f-ce169b941ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1cefd8-d331-4953-a178-b8c986f6bed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1cefd8-d331-4953-a178-b8c986f6bed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60597555-6036-4a9f-878a-0c3a93ecfcce', 'volume_name': 'volume-60597555-6036-4a9f-878a-0c3a93ecfcce', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7129c6-aaa0-4ada-9f78-72549da056cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7129c6-aaa0-4ada-9f78-72549da056cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b53a58e-b0ad-49ec-a157-f5c06e75d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:16 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Volume 60597555-6036-4a9f-878a-0c3a93ecfcce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60597555-6036-4a9f-878a-0c3a93ecfcce', 'volume_size': 1} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1292735914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60597555-6036-4a9f-878a-0c3a93ecfcce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111ca85f95cc4bb896c551337dd744dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:16Z,use_quota=True,user_id='980022194f754d07bd403f7cce58d4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Creating volume 60597555-6036-4a9f-878a-0c3a93ecfcce {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:16 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:52:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:16 devstack sudo[83298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce 1073741824 Apr 21 20:52:16 devstack sudo[83298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:17 devstack sudo[83298]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce 1073741824" returned: 0 in 1.756s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:18 devstack sudo[83346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce Apr 21 20:52:18 devstack sudo[83346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:18 devstack cinder-volume[82362]: WARNING py.warnings [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 21 20:52:18 devstack cinder-volume[82362]: .first() Apr 21 20:52:18 devstack cinder-volume[82362]: Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Flow 'volume_create_manager' (f2adbcbf-9d6d-45ae-9775-975ed8eeee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c40b26-a0f6-4a3e-8f66-98a7b2a5e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c40b26-a0f6-4a3e-8f66-98a7b2a5e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:18Z,deleted=False,deleted_at=None,display_description='',display_name='e3c04db3-f2f2-45fc-8051-15499e665acc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823e0f29-648d-4945-8e02-c86f28902cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6641f7c6e94e7e9f3b89c7a27aea31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:18Z,use_quota=True,user_id='2bb5a99457d2412097d6704c7e20793f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6bc3e7-bfd3-44fb-bb08-223b2965d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6bc3e7-bfd3-44fb-bb08-223b2965d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd29ddb-a30d-453b-b367-0aff485cb960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd29ddb-a30d-453b-b367-0aff485cb960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823e0f29-648d-4945-8e02-c86f28902cea', 'volume_name': 'volume-823e0f29-648d-4945-8e02-c86f28902cea', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816cb92c-4a97-4961-adc4-9cf09940a010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (816cb92c-4a97-4961-adc4-9cf09940a010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a88a07-f680-44f2-9a7c-fc69b2c99e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Volume 823e0f29-648d-4945-8e02-c86f28902cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823e0f29-648d-4945-8e02-c86f28902cea', 'volume_size': 1} Apr 21 20:52:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:19 devstack sudo[83346]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce" returned: 0 in 1.311s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] <== create_volume: return (3182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.192s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.717s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:19 devstack cinder-volume[82362]: INFO oslo.privsep.daemon [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjmp5d4_4/privsep.sock'] Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b53a58e-b0ad-49ec-a157-f5c06e75d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60597555-6036-4a9f-878a-0c3a93ecfcce', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b863773-24a2-4a09-9cc2-2eedb8840351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:19 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Volume volume-60597555-6036-4a9f-878a-0c3a93ecfcce (60597555-6036-4a9f-878a-0c3a93ecfcce): created successfully Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b863773-24a2-4a09-9cc2-2eedb8840351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:19 devstack sudo[83354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjmp5d4_4/privsep.sock Apr 21 20:52:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Flow 'volume_create_manager' (4abed288-72a2-48e5-9b45-d58b57d960f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:19 devstack sudo[83354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b8eda2ba-02df-47d3-be72-41d67315725d tempest-VolumesAdminNegativeTest-1232279912 None] Created volume successfully. Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:52:20 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Acquiring lock "cinder-60597555-6036-4a9f-878a-0c3a93ecfcce-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Lock "cinder-60597555-6036-4a9f-878a-0c3a93ecfcce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Acquiring lock "cinder-quobyte-60597555-6036-4a9f-878a-0c3a93ecfcce" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Lock "cinder-quobyte-60597555-6036-4a9f-878a-0c3a93ecfcce" acquired by "delete_volume" :: waited 0.036s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:21 devstack sudo[83354]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:21 devstack cinder-volume[82362]: INFO oslo.privsep.daemon [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Spawned new privsep daemon via rootwrap Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Accepted privsep connection to /tmp/tmpjmp5d4_4/privsep.sock {{(pid=82362) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 21 20:52:21 devstack cinder-volume[82362]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 21 20:52:21 devstack cinder-volume[82362]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 21 20:52:21 devstack cinder-volume[82362]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 21 20:52:21 devstack cinder-volume[82362]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83359 Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5ee0d-24e0-45d2-9fc0-10488c1d8e2e]: (2,) {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:21 devstack cinder-volume[82362]: WARNING oslo_privsep.priv_context [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] privsep daemon already running Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[012e25b1-d3e8-4d14-aaaa-68841364d4ec]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c6665-928e-4ce1-a99e-17faf66a1c54]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:22 devstack sudo[83362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe Apr 21 20:52:22 devstack sudo[83362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:22 devstack sudo[83363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce Apr 21 20:52:22 devstack sudo[83363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:22 devstack sudo[83363]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce" returned: 0 in 0.880s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:22 devstack sudo[83375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce Apr 21 20:52:22 devstack sudo[83375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack sudo[83362]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe" returned: 0 in 1.217s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.955s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.585s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:18Z,deleted=False,deleted_at=None,display_description='',display_name='e3c04db3-f2f2-45fc-8051-15499e665acc-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823e0f29-648d-4945-8e02-c86f28902cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6641f7c6e94e7e9f3b89c7a27aea31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:18Z,use_quota=True,user_id='2bb5a99457d2412097d6704c7e20793f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Creating volume 823e0f29-648d-4945-8e02-c86f28902cea {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:23 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:23 devstack sudo[83380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea 1073741824 Apr 21 20:52:23 devstack sudo[83380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3', 'name': 'volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd541e22f-ef31-4f1b-a578-6fe43dc6946e', 'enforce_multipath': True} {{(pid=82362) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:52:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-db04c8d0-9490-4427-b4ad-1a857d8baa34 req-61ab9e1b-19ba-499a-8c56-26c30a32c07a tempest-DeleteServersTestJSON-1202620190 None] attachment_update completed successfully. Apr 21 20:52:24 devstack sudo[83375]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-60597555-6036-4a9f-878a-0c3a93ecfcce" returned: 0 in 1.222s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Lock "cinder-quobyte-60597555-6036-4a9f-878a-0c3a93ecfcce" released by "delete_volume" :: held 2.810s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:24 devstack cinder-volume[82362]: WARNING cinder.quota [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:24 devstack cinder-volume[82362]: WARNING cinder.quota [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Created reservations ['480b2e73-61bc-4344-8548-d1ed5838e5d5', '073865bc-6858-4842-b0e1-ebecf00816ba', '1c6e331b-109f-4bf9-8fbb-a91d0f925bb8', '8830cd4e-72f7-4e2f-bb00-8d89106d03c0'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:24 devstack sudo[83395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:52:24 devstack sudo[83395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:25 devstack sudo[83395]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 1.272s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:25 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:25 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Deleted volume successfully. Apr 21 20:52:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f13c9070-c159-4e75-98ec-4b9dfaafaa82 tempest-VolumesAdminNegativeTest-1232279912 None] Lock "cinder-60597555-6036-4a9f-878a-0c3a93ecfcce-delete_volume" released by "delete_volume" :: held 4.637s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:25 devstack sudo[83380]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea 1073741824" returned: 0 in 2.570s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:25 devstack sudo[83805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea Apr 21 20:52:25 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:26 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea" returned: 0 in 0.612s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] <== create_volume: return (3238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.242s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a88a07-f680-44f2-9a7c-fc69b2c99e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823e0f29-648d-4945-8e02-c86f28902cea', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d10650-5c49-4e8d-ae9d-5189f42d85a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:26 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Volume volume-823e0f29-648d-4945-8e02-c86f28902cea (823e0f29-648d-4945-8e02-c86f28902cea): created successfully Apr 21 20:52:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d10650-5c49-4e8d-ae9d-5189f42d85a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Flow 'volume_create_manager' (f2adbcbf-9d6d-45ae-9775-975ed8eeee90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:26 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-832536d9-70d8-412e-b922-19da99fe51d0 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Created volume successfully. Apr 21 20:52:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-840a3573-09b4-46f1-86d3-1d98239d17f8 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-840a3573-09b4-46f1-86d3-1d98239d17f8 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:28 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b4ab2-f393-4ab7-9e28-faff48962c10]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-840a3573-09b4-46f1-86d3-1d98239d17f8 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:28 devstack sudo[83855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea Apr 21 20:52:28 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:30 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-840a3573-09b4-46f1-86d3-1d98239d17f8 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea" returned: 0 in 1.361s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-840a3573-09b4-46f1-86d3-1d98239d17f8 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.451s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:30 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-840a3573-09b4-46f1-86d3-1d98239d17f8 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3', 'name': 'volume-823e0f29-648d-4945-8e02-c86f28902cea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51f0ca30-71c2-4520-b639-f37062b17030', 'enforce_multipath': True} {{(pid=82362) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:52:30 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-fd5cae6e-d122-4782-8a6a-c6122464ad93 req-840a3573-09b4-46f1-86d3-1d98239d17f8 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] attachment_update completed successfully. Apr 21 20:52:34 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-8ce9d35b-a936-43e1-bf1d-70a0d9481681 req-65eec3b8-e098-44fa-abf5-e7c9c663f9cd tempest-DeleteServersTestJSON-1202620190 None] Terminate volume connection completed successfully. Apr 21 20:52:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-8ce9d35b-a936-43e1-bf1d-70a0d9481681 req-65eec3b8-e098-44fa-abf5-e7c9c663f9cd tempest-DeleteServersTestJSON-1202620190 None] Deleting attachment d541e22f-ef31-4f1b-a578-6fe43dc6946e. {{(pid=82362) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:52:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Acquiring lock "cinder-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Lock "cinder-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Acquiring lock "cinder-quobyte-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Lock "cinder-quobyte-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:38 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2124e979-6883-48d9-9d0b-575e550dca01]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:38 devstack sudo[84426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe Apr 21 20:52:38 devstack sudo[84426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:39 devstack sudo[84426]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe" returned: 0 in 0.926s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:39 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe Apr 21 20:52:39 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:40 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe" returned: 0 in 0.783s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Lock "cinder-quobyte-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe" released by "delete_volume" :: held 1.871s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Created reservations ['725151c5-c70a-4b53-94c8-db82d5fddf28', '1820c45b-a7e4-43ff-a0ed-68a73105ba59', 'a8e9d3ed-3bc3-4f26-9bea-b9261b3afe7e', 'cc9b97bf-5e10-497f-8f1e-4d3dc9aca98b'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:40 devstack sudo[84444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:52:40 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:41 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 1.289s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:41 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:41 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Deleted volume successfully. Apr 21 20:52:41 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb0b5eb6-1a57-4668-a71c-515337383e92 tempest-DeleteServersTestJSON-1202620190 None] Lock "cinder-ffd8bc3a-3ecd-421c-aef3-6bc38fe3effe-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:50 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=26,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=4 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:51 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:UPDATE=30,cinder:SELECT=30,cinder:INSERT=7,cinder:DELETE=2 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-dc0bf798-8297-43d0-ba32-13b093b36904 tempest-GroupsV314Test-2078314926 None] Group tempest-GroupsV314Test-Group-1386823852: creating Apr 21 20:52:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-dc0bf798-8297-43d0-ba32-13b093b36904 tempest-GroupsV314Test-2078314926 None] Group tempest-GroupsV314Test-Group-1386823852: created successfully Apr 21 20:52:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-dc0bf798-8297-43d0-ba32-13b093b36904 tempest-GroupsV314Test-2078314926 None] Create group completed successfully. Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Flow 'volume_create_manager' (8c450ce5-8243-411a-b7eb-2747bf4c7a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e25b0-c801-4e3f-b647-2ab4b8b64113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e25b0-c801-4e3f-b647-2ab4b8b64113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-66183335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d24b65-071a-4153-beee-bc918f8aaee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299672ae8bd64759a02729210a477b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:55Z,use_quota=True,user_id='0e98b2013d5243cea3ea07b63ad68ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25c49a2-8172-4f6f-b695-bd6208135c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25c49a2-8172-4f6f-b695-bd6208135c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4986ef9f-b4d9-4be7-bf5d-fab584f52899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4986ef9f-b4d9-4be7-bf5d-fab584f52899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d24b65-071a-4153-beee-bc918f8aaee4', 'volume_name': 'volume-20d24b65-071a-4153-beee-bc918f8aaee4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f00da5b-de1f-41aa-bdd0-4e12e461d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f00da5b-de1f-41aa-bdd0-4e12e461d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab9c4eb-6f32-4db5-b436-01415bc6c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:55 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Volume 20d24b65-071a-4153-beee-bc918f8aaee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d24b65-071a-4153-beee-bc918f8aaee4', 'volume_size': 1} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-66183335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d24b65-071a-4153-beee-bc918f8aaee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299672ae8bd64759a02729210a477b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:55Z,use_quota=True,user_id='0e98b2013d5243cea3ea07b63ad68ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Creating volume 20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:55 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:52:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:55 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 1073741824 Apr 21 20:52:55 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Flow 'volume_create_manager' (411cf394-e8bf-42ef-a718-f3d2b733332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aeb06b1-04d6-4832-bcfb-73573c1ebb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aeb06b1-04d6-4832-bcfb-73573c1ebb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476385673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5ba1e4d-0957-4f75-8fb0-de9c1bb4bd05,host='devstack@QuobyteHD#QuobyteHD',id=ebfcf3ed-1edd-48a8-87c9-ea44f1b42868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76ef37ca7324c5ba129710df0a689c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:56Z,use_quota=True,user_id='9ea1ae8aa7fe4a8fa47076882ec84d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6facd6c5-a638-4ddb-b0e1-692da39652bc),volume_type_id=6facd6c5-a638-4ddb-b0e1-692da39652bc)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f07e151-4360-4ca1-abb8-e48d3948d02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f07e151-4360-4ca1-abb8-e48d3948d02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ae1480-d8d0-4c14-9b81-9f4e9cb27aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ae1480-d8d0-4c14-9b81-9f4e9cb27aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfcf3ed-1edd-48a8-87c9-ea44f1b42868', 'volume_name': 'volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedfd2c1-c370-46ee-97e2-ebd220c6e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedfd2c1-c370-46ee-97e2-ebd220c6e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9962927a-a82b-48bb-8ce0-c82f3fd5669e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:56 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Volume ebfcf3ed-1edd-48a8-87c9-ea44f1b42868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868', 'volume_size': 1} Apr 21 20:52:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:57 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 1073741824" returned: 0 in 1.845s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:57 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 Apr 21 20:52:57 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:58 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Flow 'volume_create_manager' (5c62d6e9-1339-4bcd-989f-f1afcfdfadea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b251ad7b-4e9e-4490-b696-6ce4edf7ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4" returned: 0 in 0.941s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] <== create_volume: return (2895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.899s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5ba1e4d-0957-4f75-8fb0-de9c1bb4bd05,created_at=2026-04-21T18:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476385673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5ba1e4d-0957-4f75-8fb0-de9c1bb4bd05,host='devstack@QuobyteHD#QuobyteHD',id=ebfcf3ed-1edd-48a8-87c9-ea44f1b42868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76ef37ca7324c5ba129710df0a689c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:56Z,use_quota=True,user_id='9ea1ae8aa7fe4a8fa47076882ec84d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6facd6c5-a638-4ddb-b0e1-692da39652bc),volume_type_id=6facd6c5-a638-4ddb-b0e1-692da39652bc)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Creating volume ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:58 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b251ad7b-4e9e-4490-b696-6ce4edf7ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-323873416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22d3629-1986-4b68-8339-80db98f54134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0e5631eba54421b521f657ae4730cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:58Z,use_quota=True,user_id='cd1702fb715c48d0a95ac2d75729d686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fbbb6d-4bdb-4f74-8918-d197e0f220a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1fbbb6d-4bdb-4f74-8918-d197e0f220a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:58 devstack sudo[84640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 1073741824 Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9a35f8-67e1-484d-b98a-f1fce44d9f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:58 devstack sudo[84640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc9a35f8-67e1-484d-b98a-f1fce44d9f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22d3629-1986-4b68-8339-80db98f54134', 'volume_name': 'volume-b22d3629-1986-4b68-8339-80db98f54134', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c97f7d0-a86b-4b5e-9b33-c4cda8f98a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c97f7d0-a86b-4b5e-9b33-c4cda8f98a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8381d3-cd99-4955-8309-c4cf8725a465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:58 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Volume b22d3629-1986-4b68-8339-80db98f54134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22d3629-1986-4b68-8339-80db98f54134', 'volume_size': 1} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab9c4eb-6f32-4db5-b436-01415bc6c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d24b65-071a-4153-beee-bc918f8aaee4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abd74c2-9bce-46d7-afe0-79d1548afd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:58 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Volume volume-20d24b65-071a-4153-beee-bc918f8aaee4 (20d24b65-071a-4153-beee-bc918f8aaee4): created successfully Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6abd74c2-9bce-46d7-afe0-79d1548afd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Flow 'volume_create_manager' (8c450ce5-8243-411a-b7eb-2747bf4c7a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:58 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-05591ead-0e14-42f3-9b0a-427884b7e804 req-d956c850-a41a-48d8-9fe4-97508621e066 tempest-VolumesSnapshotsTestJSON-1008184798 None] Created volume successfully. Apr 21 20:52:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:59 devstack sudo[84640]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 1073741824" returned: 0 in 1.008s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:59 devstack sudo[84646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 Apr 21 20:52:59 devstack sudo[84646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:59 devstack sudo[84646]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" returned: 0 in 0.729s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-323873416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22d3629-1986-4b68-8339-80db98f54134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0e5631eba54421b521f657ae4730cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:58Z,use_quota=True,user_id='cd1702fb715c48d0a95ac2d75729d686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Creating volume b22d3629-1986-4b68-8339-80db98f54134 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:00 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9962927a-a82b-48bb-8ce0-c82f3fd5669e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e187b5de-111b-4025-ac44-54d299c05f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:00 devstack sudo[84650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 1073741824 Apr 21 20:53:00 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:00 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Volume volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 (ebfcf3ed-1edd-48a8-87c9-ea44f1b42868): created successfully Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e187b5de-111b-4025-ac44-54d299c05f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Flow 'volume_create_manager' (411cf394-e8bf-42ef-a718-f3d2b733332c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:00 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c65f924c-f304-4208-ac9d-ed746a91c4e2 tempest-GroupsV314Test-2078314926 None] Created volume successfully. Apr 21 20:53:00 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 1073741824" returned: 0 in 0.611s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:00 devstack sudo[84655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 Apr 21 20:53:00 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:01 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134" returned: 0 in 0.728s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.498s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8381d3-cd99-4955-8309-c4cf8725a465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22d3629-1986-4b68-8339-80db98f54134', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c43bd1e-3a01-41be-9b95-f1d460ca985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Creating offline snapshot acc758e2-9edd-4db8-8ecb-7b6483ad40d3 of volume 20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[298585b9-a035-4429-823f-0ec3caaef66e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:01 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Volume volume-b22d3629-1986-4b68-8339-80db98f54134 (b22d3629-1986-4b68-8339-80db98f54134): created successfully Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c43bd1e-3a01-41be-9b95-f1d460ca985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Flow 'volume_create_manager' (5c62d6e9-1339-4bcd-989f-f1afcfdfadea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ef0d415c-0276-4de0-9c43-e19614e79525 tempest-ServerRescueNegativeTestJSON-1598808211 None] Created volume successfully. Apr 21 20:53:01 devstack sudo[84682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 Apr 21 20:53:01 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:02 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4" returned: 0 in 0.845s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:02 devstack sudo[84711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 1G Apr 21 20:53:02 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:02 devstack sudo[84715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:53:02 devstack sudo[84715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack sudo[84715]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.937s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:03 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 1G" returned: 0 in 1.274s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d24b65-071a-4153-beee-bc918f8aaee4 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:03 devstack sudo[84723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d24b65-071a-4153-beee-bc918f8aaee4 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 Apr 21 20:53:03 devstack sudo[84723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[84723]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d24b65-071a-4153-beee-bc918f8aaee4 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3" returned: 0 in 0.698s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 is being set with open permissions: ugo+rw Apr 21 20:53:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[84732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 Apr 21 20:53:04 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3" returned: 0 in 0.824s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack sudo[84760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.info Apr 21 20:53:05 devstack sudo[84760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack sudo[84760]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.info" returned: 0 in 0.560s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.info is being set with open permissions: ugo+rw Apr 21 20:53:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack sudo[84766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.info Apr 21 20:53:05 devstack sudo[84766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:06 devstack sudo[84766]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.info" returned: 0 in 0.587s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.914s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.776s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:06 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Cloning volume ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 to volume 9693f623-ffa3-4dfb-8193-eb4a1db3aad6 Apr 21 20:53:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Creating offline snapshot f3fba325-b5c8-4707-a07c-38b9e5debd53 of volume ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-93c56110-722d-4fd3-81a1-1d3b9c98c81a req-af29b7cd-845b-4e38-a5dd-95123912fe0b tempest-VolumesSnapshotsTestJSON-1008184798 None] Create snapshot completed successfully Apr 21 20:53:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8711b9d5-b93c-4589-bdff-68d8be5042dc]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:06 devstack sudo[84771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 Apr 21 20:53:06 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "cinder-acc758e2-9edd-4db8-8ecb-7b6483ad40d3-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-acc758e2-9edd-4db8-8ecb-7b6483ad40d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "cinder-quobyte-20d24b65-071a-4153-beee-bc918f8aaee4" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:07 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" returned: 0 in 0.788s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-quobyte-20d24b65-071a-4153-beee-bc918f8aaee4" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "cinder-quobyte-acc758e2-9edd-4db8-8ecb-7b6483ad40d3" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:07 devstack sudo[84802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 1G Apr 21 20:53:07 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-quobyte-acc758e2-9edd-4db8-8ecb-7b6483ad40d3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Deleting offline snapshot acc758e2-9edd-4db8-8ecb-7b6483ad40d3 of volume 20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] snapshot_file for this snap is: volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a5975-cf67-4f8f-93cc-922fb0675516]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:07 devstack sudo[84810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 Apr 21 20:53:07 devstack sudo[84810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:07 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 1G" returned: 0 in 0.771s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[84820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 Apr 21 20:53:08 devstack sudo[84820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[84810]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3" returned: 0 in 0.876s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d24b65-071a-4153-beee-bc918f8aaee4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25ce15a-b32f-4985-8289-aea88f62ee5f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[84827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 Apr 21 20:53:08 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[84820]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53" returned: 0 in 0.646s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[84832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 Apr 21 20:53:08 devstack sudo[84832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4" returned: 0 in 0.716s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[84837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 Apr 21 20:53:08 devstack sudo[84837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:09 devstack sudo[84832]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53" returned: 0 in 0.658s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:09 devstack sudo[84841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.info Apr 21 20:53:09 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:09 devstack sudo[84837]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3" returned: 0 in 0.634s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:09 devstack sudo[84846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3 Apr 21 20:53:09 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:10 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.info" returned: 0 in 0.721s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:10 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:10 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.info Apr 21 20:53:10 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:10 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4.acc758e2-9edd-4db8-8ecb-7b6483ad40d3" returned: 0 in 0.655s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-quobyte-acc758e2-9edd-4db8-8ecb-7b6483ad40d3" released by "_delete_snapshot" :: held 2.995s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-quobyte-20d24b65-071a-4153-beee-bc918f8aaee4" released by "delete_snapshot" :: held 3.046s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:10 devstack cinder-volume[82362]: WARNING cinder.quota [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:10 devstack cinder-volume[82362]: DEBUG cinder.quota [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Created reservations ['721abdce-4104-4164-8210-ec680dbd5633', '15d48c11-66d4-4415-868e-a76215ecd326', '5b93b071-baef-4ef6-ae88-052fb168eda2', '872a2a3e-0ab3-497a-b675-e748d6f6d969'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:10 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Delete snapshot completed successfully. Apr 21 20:53:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-6350d586-827a-4156-80ef-6d80e09d7185 req-30c46730-6397-45b1-8a2c-0b7613308f55 tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-acc758e2-9edd-4db8-8ecb-7b6483ad40d3-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:11 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.info" returned: 0 in 0.954s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Acquiring lock "cinder-quobyte-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] snapshot: f3fba325-b5c8-4707-a07c-38b9e5debd53, volume: 9693f623-ffa3-4dfb-8193-eb4a1db3aad6, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5781aa8-6d54-45d3-ae32-f62c18e5c117]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:11 devstack sudo[84868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 Apr 21 20:53:11 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "cinder-20d24b65-071a-4153-beee-bc918f8aaee4-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-20d24b65-071a-4153-beee-bc918f8aaee4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "cinder-quobyte-20d24b65-071a-4153-beee-bc918f8aaee4" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-quobyte-20d24b65-071a-4153-beee-bc918f8aaee4" acquired by "delete_volume" :: waited 0.057s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25e1d6-2931-4bdc-89fd-e9c8506fa566]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:12 devstack sudo[84911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 Apr 21 20:53:12 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:12 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53" returned: 0 in 1.880s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:53:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:53:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf4b75b-015a-4119-9207-f98b54cba846]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 Apr 21 20:53:13 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:13 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4" returned: 0 in 1.661s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4 Apr 21 20:53:13 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:13 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" returned: 0 in 0.946s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:13 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:53:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[84951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 Apr 21 20:53:13 devstack sudo[84951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:14 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-20d24b65-071a-4153-beee-bc918f8aaee4" returned: 0 in 0.687s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-quobyte-20d24b65-071a-4153-beee-bc918f8aaee4" released by "delete_volume" :: held 2.526s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG cinder.quota [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Created reservations ['4ce4050f-9580-4fb8-8365-b3df1f37659a', 'b39f3ca6-2c5c-45e5-bfac-2d16f20cc57b', '1b4ad21b-522b-47b3-ac16-160041fd73b2', '2612499f-8fe9-4c23-8e3e-2643717c5480'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:14 devstack sudo[84970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:53:14 devstack sudo[84970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:18 devstack sudo[84970]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 3.606s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:18 devstack cinder-volume[82362]: DEBUG cinder.manager [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:18 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Deleted volume successfully. Apr 21 20:53:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-60aa62cf-327f-41ca-92b3-41b597b18bfe req-ff63f1a8-a80b-4204-8e48-370a453ff4ed tempest-VolumesSnapshotsTestJSON-1008184798 None] Lock "cinder-20d24b65-071a-4153-beee-bc918f8aaee4-delete_volume" released by "delete_volume" :: held 6.717s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:18 devstack sudo[84951]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" returned: 0 in 4.842s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:18 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aedc8e6-531f-4b9e-88e8-50b8f26bd676]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:19 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 Apr 21 20:53:19 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:19 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" returned: 0 in 1.065s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:19 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:53:19 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Converted 1024.00 MB image at 211.43 MB/s Apr 21 20:53:19 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:19 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 Apr 21 20:53:19 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:20 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" returned: 0 in 0.969s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" released by "_copy_volume_from_snapshot" :: held 9.827s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Acquiring lock "cinder-quobyte-f3fba325-b5c8-4707-a07c-38b9e5debd53" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-f3fba325-b5c8-4707-a07c-38b9e5debd53" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Deleting offline snapshot f3fba325-b5c8-4707-a07c-38b9e5debd53 of volume ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] snapshot_file for this snap is: volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc24c3a-dbd2-425d-ae88-321d86e8be1c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:21 devstack sudo[85125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 Apr 21 20:53:21 devstack sudo[85125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:22 devstack sudo[85125]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53" returned: 0 in 1.665s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:22 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd82c2-4705-4dad-894d-c031a360e1bd]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:22 devstack sudo[85139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 Apr 21 20:53:22 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Flow 'volume_create_manager' (985c2afb-54c8-4cd3-a61a-26c1a0a4bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3e5442-3160-4dfe-bb2b-627e103d6309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3e5442-3160-4dfe-bb2b-627e103d6309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1372165661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7281429-4ec7-43d6-a9c1-a529c57e14b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='892d557a87264c0898b236fd98b2428e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:24Z,use_quota=True,user_id='348a5d5c2b104dd8bd4ebaf639f11683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9d5449-2cc3-417d-b54d-54c52e1723b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9d5449-2cc3-417d-b54d-54c52e1723b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb715842-a50c-47f8-aca4-88193d4260af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb715842-a50c-47f8-aca4-88193d4260af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7281429-4ec7-43d6-a9c1-a529c57e14b2', 'volume_name': 'volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ace7b4c-4de2-46cb-807a-10f6223447e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ace7b4c-4de2-46cb-807a-10f6223447e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0444e63d-a60b-40fb-8da0-f80172b90686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:23 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Volume b7281429-4ec7-43d6-a9c1-a529c57e14b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2', 'volume_size': 1} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:23 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" returned: 0 in 1.131s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:23 devstack sudo[85146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 Apr 21 20:53:23 devstack sudo[85146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Acquiring lock "cinder-b22d3629-1986-4b68-8339-80db98f54134-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "cinder-b22d3629-1986-4b68-8339-80db98f54134-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Acquiring lock "cinder-quobyte-b22d3629-1986-4b68-8339-80db98f54134" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "cinder-quobyte-b22d3629-1986-4b68-8339-80db98f54134" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3754db-542c-43ff-a4ad-73e646e94b11]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:24 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 Apr 21 20:53:24 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:24 devstack sudo[85146]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53" returned: 0 in 1.108s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:24 devstack sudo[85155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53 Apr 21 20:53:24 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:25 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134" returned: 0 in 1.057s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:25 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134 Apr 21 20:53:25 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:25 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868.f3fba325-b5c8-4707-a07c-38b9e5debd53" returned: 0 in 0.828s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-f3fba325-b5c8-4707-a07c-38b9e5debd53" released by "_delete_snapshot" :: held 4.943s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.584s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.098s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1372165661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7281429-4ec7-43d6-a9c1-a529c57e14b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='892d557a87264c0898b236fd98b2428e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:24Z,use_quota=True,user_id='348a5d5c2b104dd8bd4ebaf639f11683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Creating volume b7281429-4ec7-43d6-a9c1-a529c57e14b2 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:25 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:53:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:25 devstack sudo[85171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 1073741824 Apr 21 20:53:25 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:26 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b22d3629-1986-4b68-8339-80db98f54134" returned: 0 in 0.797s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "cinder-quobyte-b22d3629-1986-4b68-8339-80db98f54134" released by "delete_volume" :: held 1.942s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:26 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5482b6eb-e137-4667-a629-713dc0e91330 tempest-GroupsV314Test-2078314926 None] Create group from source-group-f5ba1e4d-0957-4f75-8fb0-de9c1bb4bd05 completed successfully. Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Created reservations ['91ea55ea-ec55-4903-9f42-9f69ca9dedec', '385be785-7aeb-44c3-9f63-57101b5c50f8', '2e733d34-6abf-428b-aa19-51b49625bec7', '3a037612-0495-4cbe-84f4-e95feece9254'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:26 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:53:26 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:26 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.612s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:26 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Deleted volume successfully. Apr 21 20:53:26 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a1f3ecba-351b-49b9-881a-bd70a52f9678 tempest-ServerRescueNegativeTestJSON-1598808211 None] Lock "cinder-b22d3629-1986-4b68-8339-80db98f54134-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:27 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 1073741824" returned: 0 in 1.567s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:27 devstack sudo[85200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 Apr 21 20:53:27 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Acquiring lock "cinder-quobyte-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:27 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0bd14e-eb6d-46e1-ab9a-0890cb07d2ba]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:27 devstack sudo[85207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 Apr 21 20:53:27 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:28 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2" returned: 0 in 1.106s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] <== create_volume: return (2717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.720s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0444e63d-a60b-40fb-8da0-f80172b90686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339a8f0c-26c5-4ace-9ad5-6048389447eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:28 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Volume volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 (b7281429-4ec7-43d6-a9c1-a529c57e14b2): created successfully Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339a8f0c-26c5-4ace-9ad5-6048389447eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Flow 'volume_create_manager' (985c2afb-54c8-4cd3-a61a-26c1a0a4bda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-ae20750a-f78a-469e-8d52-32aa07d7cd02 req-9c600dbb-f5d9-44d0-a7cf-4622e36c2d1d tempest-VolumesGetTestJSON-371356674 None] Created volume successfully. Apr 21 20:53:28 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" returned: 0 in 1.152s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:28 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6 Apr 21 20:53:28 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:29 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" returned: 0 in 0.579s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-9693f623-ffa3-4dfb-8193-eb4a1db3aad6" released by "delete_volume" :: held 1.805s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Created reservations ['d1ce97fb-6710-48b4-a487-ffcb39bae273'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:29 devstack cinder-volume[82362]: WARNING cinder.quota [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-947677727 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-947677727, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:29 devstack cinder-volume[82362]: WARNING cinder.quota [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-947677727 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-947677727, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Created reservations ['fb1d57e8-63cd-4a2a-adcf-2d398e5c1083', 'e71fe63f-8941-4ac8-8019-4353f31f73e6', 'df8901c0-b406-4584-bd23-942adfcb81a6', '2200b9a7-a699-4223-a42b-dc79e01c1eb3'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:29 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:53:29 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Acquiring lock "cinder-b7281429-4ec7-43d6-a9c1-a529c57e14b2-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Lock "cinder-b7281429-4ec7-43d6-a9c1-a529c57e14b2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Acquiring lock "cinder-quobyte-b7281429-4ec7-43d6-a9c1-a529c57e14b2" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Lock "cinder-quobyte-b7281429-4ec7-43d6-a9c1-a529c57e14b2" acquired by "delete_volume" :: waited 0.031s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c59ae9-e2e3-476d-97c3-c33b3ab3b9ce]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:30 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.672s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:30 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-efd093f3-45ce-4bfb-883b-6c4c7c517996 tempest-GroupsV314Test-2078314926 None] Delete group completed successfully. Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Acquiring lock "cinder-quobyte-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:30 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 Apr 21 20:53:30 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[734d8f0e-f037-4a8a-949e-12cd31dccbd1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:30 devstack sudo[85289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 Apr 21 20:53:30 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:31 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2" returned: 0 in 1.287s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:31 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2 Apr 21 20:53:31 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:31 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" returned: 0 in 1.119s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:31 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868 Apr 21 20:53:31 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:32 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" returned: 0 in 0.722s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Lock "cinder-quobyte-ebfcf3ed-1edd-48a8-87c9-ea44f1b42868" released by "delete_volume" :: held 1.986s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Created reservations ['467c9df6-3ac9-4e75-8953-dd881621ce2a'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Created reservations ['a9308524-fdf6-4e42-b39f-00daf0b0408e', 'e9b61c83-92bc-4a2f-9e87-8de7f4222fad', '68ccd77a-75a7-469e-b24d-cd287024a131', '98110294-3ae2-4bd8-b595-5dbaa1c24634'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:32 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7281429-4ec7-43d6-a9c1-a529c57e14b2" returned: 0 in 1.185s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Lock "cinder-quobyte-b7281429-4ec7-43d6-a9c1-a529c57e14b2" released by "delete_volume" :: held 2.543s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:32 devstack sudo[85304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:53:32 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:32 devstack cinder-volume[82362]: DEBUG cinder.quota [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Created reservations ['249f7e93-e013-4552-9194-73012391ae48', 'cc55a85f-7be2-4b5f-a45d-0f09f8f099a2', '1b22ac0e-29f2-49d4-b5f4-f7327e754c45', '3de8c9d4-bc26-4fc3-832b-5cb4b9ed9611'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:33 devstack sudo[85306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:53:33 devstack sudo[85306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:33 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.964s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:33 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:33 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a87ebcb8-343f-4ff2-b5fa-db94484f14b0 tempest-GroupsV314Test-2078314926 None] Delete group completed successfully. Apr 21 20:53:34 devstack sudo[85306]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 1.473s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:34 devstack cinder-volume[82362]: DEBUG cinder.manager [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:34 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Deleted volume successfully. Apr 21 20:53:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-13af5eb6-b9dc-4591-917d-15c6dbf0f4fb req-10c46563-a453-4e81-a9c6-e983c56d70ef tempest-VolumesGetTestJSON-371356674 None] Lock "cinder-b7281429-4ec7-43d6-a9c1-a529c57e14b2-delete_volume" released by "delete_volume" :: held 4.512s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Flow 'volume_create_manager' (b51b9713-ce1d-472f-8858-baf0d45ec51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e23e0a-de4a-40e1-8e3d-fc13f4d8bd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e23e0a-de4a-40e1-8e3d-fc13f4d8bd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1635554433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a37fe0-099e-48ea-8306-ba8e188db29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a5f90cf1704ceda42739f87f0776ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:38Z,use_quota=True,user_id='cc35e099804b4242ad42e7f6f9fa5b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b50b492-bd42-48f5-a290-ff17620f47e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b50b492-bd42-48f5-a290-ff17620f47e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbf462b-9b74-498b-bde5-40ac5510cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbf462b-9b74-498b-bde5-40ac5510cbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a37fe0-099e-48ea-8306-ba8e188db29b', 'volume_name': 'volume-64a37fe0-099e-48ea-8306-ba8e188db29b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd9886f-d7d7-4e40-b791-bd1818844932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd9886f-d7d7-4e40-b791-bd1818844932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d47c534-e378-402e-90f4-247aa368729d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:38 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Volume 64a37fe0-099e-48ea-8306-ba8e188db29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a37fe0-099e-48ea-8306-ba8e188db29b', 'volume_size': 1} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1635554433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a37fe0-099e-48ea-8306-ba8e188db29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81a5f90cf1704ceda42739f87f0776ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:38Z,use_quota=True,user_id='cc35e099804b4242ad42e7f6f9fa5b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Creating volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:38 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:53:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:38 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b 1073741824 Apr 21 20:53:38 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e719cfd-2463-4b6e-b9d9-14d2f131ef36 tempest-BackendsCapabilitiesAdminTestsJSON-977478559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82362) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:53:39 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b 1073741824" returned: 0 in 0.511s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:39 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b Apr 21 20:53:39 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:39 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b" returned: 0 in 0.431s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d47c534-e378-402e-90f4-247aa368729d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a37fe0-099e-48ea-8306-ba8e188db29b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5574944-b9fa-4eb5-b6a4-f158d771b038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:39 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Volume volume-64a37fe0-099e-48ea-8306-ba8e188db29b (64a37fe0-099e-48ea-8306-ba8e188db29b): created successfully Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5574944-b9fa-4eb5-b6a4-f158d771b038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Flow 'volume_create_manager' (b51b9713-ce1d-472f-8858-baf0d45ec51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ecabe02c-ec1f-4589-821c-1a69a62381d5 tempest-SnapshotsActionsTest-1830799572 None] Created volume successfully. Apr 21 20:53:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-029be057-9a5c-4c84-ba70-b46306f6f415 tempest-BackendsCapabilitiesAdminTestsJSON-977478559 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82362) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:53:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Creating offline snapshot 5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:40 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c8b19e-872b-455f-9a08-263f78213ace]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:40 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b Apr 21 20:53:40 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:41 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b" returned: 0 in 0.683s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:41 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c 1G Apr 21 20:53:41 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:42 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c 1G" returned: 0 in 0.983s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:42 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:53:42 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:43 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.798s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:43 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c is being set with open permissions: ugo+rw Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:43 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:53:43 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Flow 'volume_create_manager' (e13a7ff2-da3a-4fe4-827f-f63233c0f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b12f95-84a8-41f2-a17e-563eb9e0c04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b12f95-84a8-41f2-a17e-563eb9e0c04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9b070e-c275-41f5-b6e9-68c16964ec40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6641f7c6e94e7e9f3b89c7a27aea31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:43Z,use_quota=True,user_id='2bb5a99457d2412097d6704c7e20793f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b933ed01-e25a-405a-ace7-6ab1a90782dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b933ed01-e25a-405a-ace7-6ab1a90782dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3036dcf2-53b4-4435-9e5b-43f316ac0f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:43 devstack cinder-volume[82362]: DEBUG cinder.image.glance [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Creating Keystone auth plugin from conf {{(pid=82362) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:53:44 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 1.036s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:44 devstack sudo[85378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.info Apr 21 20:53:44 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3036dcf2-53b4-4435-9e5b-43f316ac0f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a9b070e-c275-41f5-b6e9-68c16964ec40', 'volume_name': 'volume-6a9b070e-c275-41f5-b6e9-68c16964ec40', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28c7775-a7e6-4853-8dce-4408431794f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28c7775-a7e6-4853-8dce-4408431794f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab847f92-1bd5-4c70-b30e-4ea0fe26b2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Volume 6a9b070e-c275-41f5-b6e9-68c16964ec40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a9b070e-c275-41f5-b6e9-68c16964ec40', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Trying to clone 6a9b070e-c275-41f5-b6e9-68c16964ec40 from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]). {{(pid=82362) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:53:44 devstack cinder-volume[82362]: INFO cinder.image.image_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b50b60-2c92-4075-a091-bd6996c8b01f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:45 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD Apr 21 20:53:45 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:45 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.info" returned: 0 in 0.812s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:45 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.info is being set with open permissions: ugo+rw Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:45 devstack sudo[85405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.info Apr 21 20:53:45 devstack sudo[85405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fecb854f-2953-445b-8f64-eea95235db24 tempest-GroupSnapshotsV319Test-1023651372 None] Group tempest-GroupSnapshotsV319Test-Group-1273411229: creating Apr 21 20:53:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fecb854f-2953-445b-8f64-eea95235db24 tempest-GroupSnapshotsV319Test-1023651372 None] Group tempest-GroupSnapshotsV319Test-Group-1273411229: created successfully Apr 21 20:53:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fecb854f-2953-445b-8f64-eea95235db24 tempest-GroupSnapshotsV319Test-1023651372 None] Create group completed successfully. Apr 21 20:53:45 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 is fetched for user 2bb5a99457d2412097d6704c7e20793f. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[86968e27-fdb8-401d-bfee-acf58a46fc66]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:45 devstack sudo[85405]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.info" returned: 0 in 0.717s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.123s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:45 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD Apr 21 20:53:45 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c1dc8ea4-73a6-4a64-810d-85fc103195fa tempest-SnapshotsActionsTest-1830799572 None] Create snapshot completed successfully Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Creating offline snapshot b48f19d4-8a6b-405b-a75a-b331b1f1d4aa of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:46 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD" returned: 0 in 0.923s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[956b5ab2-a0c9-4eec-9318-a9a5fccb36d8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:46 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:53:46 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Flow 'volume_create_manager' (b1a54c59-820d-4823-a70e-e58f4c339db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7068be-f09a-46cf-abaf-0f4d10ed6d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7068be-f09a-46cf-abaf-0f4d10ed6d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1863186620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b4f0a69-411c-4f8f-9fe4-d0801c0dc7e0,host='devstack@QuobyteHD#QuobyteHD',id=91dd99d5-a21f-4772-887c-36832101b946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9308c6a243e45198b0e8240783e8013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:47Z,use_quota=True,user_id='bffb2747e24f454fa2d8814bece2bde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f9ebe8-b903-42db-bcf5-109bea795bff),volume_type_id=58f9ebe8-b903-42db-bcf5-109bea795bff)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dde7cb0-4031-4b8a-b182-03a7801ab3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dde7cb0-4031-4b8a-b182-03a7801ab3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069bdee1-1b10-4ff8-a242-2c197367c913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069bdee1-1b10-4ff8-a242-2c197367c913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91dd99d5-a21f-4772-887c-36832101b946', 'volume_name': 'volume-91dd99d5-a21f-4772-887c-36832101b946', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce1ae2f-73cd-45bf-99db-d2bd83bf1f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce1ae2f-73cd-45bf-99db-d2bd83bf1f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e873b8-3f62-42c2-9058-3aa07086c5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:47 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Volume 91dd99d5-a21f-4772-887c-36832101b946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91dd99d5-a21f-4772-887c-36832101b946', 'volume_size': 1} Apr 21 20:53:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:47 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.630s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:47 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa 1G Apr 21 20:53:47 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa 1G" returned: 0 in 0.670s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:48 devstack sudo[85432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa Apr 21 20:53:48 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" returned: 0 in 0.488s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:48 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa is being set with open permissions: ugo+rw Apr 21 20:53:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:48 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa Apr 21 20:53:48 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:43Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9b070e-c275-41f5-b6e9-68c16964ec40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6641f7c6e94e7e9f3b89c7a27aea31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:43Z,use_quota=True,user_id='2bb5a99457d2412097d6704c7e20793f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Creating volume 6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:49 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 1073741824 Apr 21 20:53:49 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3f62782b-ae92-4c35-98c7-7d9e3f7204ef tempest-SnapshotsActionsTest-1830799572 None] Create snapshot completed successfully Apr 21 20:53:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-86c12672-17de-4dec-a7e8-259f2d109e58 tempest-GroupSnapshotsTest-1468255330 None] Group tempest-GroupSnapshotsTest-Group-1130257902: creating Apr 21 20:53:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-86c12672-17de-4dec-a7e8-259f2d109e58 tempest-GroupSnapshotsTest-1468255330 None] Group tempest-GroupSnapshotsTest-Group-1130257902: created successfully Apr 21 20:53:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-86c12672-17de-4dec-a7e8-259f2d109e58 tempest-GroupSnapshotsTest-1468255330 None] Create group completed successfully. Apr 21 20:53:49 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 1073741824" returned: 0 in 0.682s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[85489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:53:49 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-b48f19d4-8a6b-405b-a75a-b331b1f1d4aa-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-b48f19d4-8a6b-405b-a75a-b331b1f1d4aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Deleting offline snapshot b48f19d4-8a6b-405b-a75a-b331b1f1d4aa of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] snapshot_file for this snap is: volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e35f3fb-30c7-44de-92ea-ba6f5e9a4528]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa Apr 21 20:53:50 devstack sudo[85491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 0 in 0.497s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.212s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8b4f0a69-411c-4f8f-9fe4-d0801c0dc7e0,created_at=2026-04-21T18:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1863186620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8b4f0a69-411c-4f8f-9fe4-d0801c0dc7e0,host='devstack@QuobyteHD#QuobyteHD',id=91dd99d5-a21f-4772-887c-36832101b946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9308c6a243e45198b0e8240783e8013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:47Z,use_quota=True,user_id='bffb2747e24f454fa2d8814bece2bde9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58f9ebe8-b903-42db-bcf5-109bea795bff),volume_type_id=58f9ebe8-b903-42db-bcf5-109bea795bff)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Creating volume 91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:50 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 1073741824 Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Attempting download of ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume 6a9b070e-c275-41f5-b6e9-68c16964ec40. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:53:50 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3183cf2b-2d4e-4f5a-8198-7fee3f7d4fa7]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_od2kictn {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_od2kictn Apr 21 20:53:50 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[85491]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" returned: 0 in 0.601s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[584a8247-e990-4dfe-ba84-3e16e6c1764b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:53:50 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_od2kictn" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_od2kictn {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_od2kictn Apr 21 20:53:50 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 1073741824" returned: 0 in 0.879s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=83,cinder:INSERT=18,cinder:UPDATE=83,cinder:DELETE=7 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:51 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 Apr 21 20:53:51 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (7f8ee822-8820-40ed-a74d-a149b2a90149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12492234-53ab-49a3-a635-e47e5b80c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12492234-53ab-49a3-a635-e47e5b80c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97608736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=424bbf1b-a22a-4708-93cb-9d4253a42a3d,host='devstack@QuobyteHD#QuobyteHD',id=a02dfc12-c914-461b-89dd-af0cc81912cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:51Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f1b9016-6a10-41f9-a7dd-ba0958e7d376),volume_type_id=6f1b9016-6a10-41f9-a7dd-ba0958e7d376)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d3b280-1053-496b-853e-d272d782b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d3b280-1053-496b-853e-d272d782b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d93124-e5dc-4149-b841-922f3a1ed78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d93124-e5dc-4149-b841-922f3a1ed78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02dfc12-c914-461b-89dd-af0cc81912cf', 'volume_name': 'volume-a02dfc12-c914-461b-89dd-af0cc81912cf', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99eab474-1e78-49b0-9657-4169ca31b243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99eab474-1e78-49b0-9657-4169ca31b243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94f7750-ca88-45ab-b251-8f922b82cc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:51 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Volume a02dfc12-c914-461b-89dd-af0cc81912cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02dfc12-c914-461b-89dd-af0cc81912cf', 'volume_size': 1} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:51 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_od2kictn" returned: 1 in 0.643s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_od2kictn' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6256b0-0f7e-4f93-8dd7-634f47ef2488]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.816s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[85518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa Apr 21 20:53:51 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD Apr 21 20:53:51 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946" returned: 0 in 0.572s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=424bbf1b-a22a-4708-93cb-9d4253a42a3d,created_at=2026-04-21T18:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97608736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=424bbf1b-a22a-4708-93cb-9d4253a42a3d,host='devstack@QuobyteHD#QuobyteHD',id=a02dfc12-c914-461b-89dd-af0cc81912cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:51Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f1b9016-6a10-41f9-a7dd-ba0958e7d376),volume_type_id=6f1b9016-6a10-41f9-a7dd-ba0958e7d376)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Creating volume a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:51 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf 1073741824 Apr 21 20:53:51 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e873b8-3f62-42c2-9058-3aa07086c5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91dd99d5-a21f-4772-887c-36832101b946', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c854a5-ade5-4d4d-8409-f8853ce3dacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:51 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Volume volume-91dd99d5-a21f-4772-887c-36832101b946 (91dd99d5-a21f-4772-887c-36832101b946): created successfully Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c854a5-ade5-4d4d-8409-f8853ce3dacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Flow 'volume_create_manager' (b1a54c59-820d-4823-a70e-e58f4c339db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:51 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-65ca906b-1230-4b01-b435-f0c842432033 tempest-GroupSnapshotsV319Test-1023651372 None] Created volume successfully. Apr 21 20:53:51 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=68,cinder:UPDATE=81,cinder:INSERT=20,cinder:DELETE=5 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:53:52 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" returned: 0 in 0.592s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:52 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa Apr 21 20:53:52 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:52 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 was qcow2, converting to raw {{(pid=82362) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:52 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:53:52 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:52 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf 1073741824" returned: 0 in 0.634s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:52 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf Apr 21 20:53:52 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] GroupSnapshot 39553f9a-2e85-48e3-aa3d-0e031b699fcd: creating. Apr 21 20:53:52 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" returned: 0 in 0.601s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-b48f19d4-8a6b-405b-a75a-b331b1f1d4aa" released by "_delete_snapshot" :: held 2.671s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Group snapshot 39553f9a-2e85-48e3-aa3d-0e031b699fcd: creating. {{(pid=82362) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" released by "delete_snapshot" :: held 2.699s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Created reservations ['cd4d2551-c75f-46c6-b314-5c2ec750e306', 'afea0556-4904-4f8c-b10a-69ebf6843d48', '2ea288e6-4e79-4bb1-a094-2cc5864f30da', 'a6cc6d84-2ca7-4b9b-ba71-6dbb9971e51b'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Delete snapshot completed successfully. Apr 21 20:53:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-103c5077-89bf-4e41-ab8c-4a0fc6beb352 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-b48f19d4-8a6b-405b-a75a-b331b1f1d4aa-delete_snapshot" released by "delete_snapshot" :: held 2.832s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:53 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf" returned: 0 in 0.724s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Creating offline snapshot d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed of volume 91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94f7750-ca88-45ab-b251-8f922b82cc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02dfc12-c914-461b-89dd-af0cc81912cf', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f187bbc4-4625-4366-9a59-cf27d01b6999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6dcf24-59e1-4461-aade-ad3b2ad09978]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:53 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Volume volume-a02dfc12-c914-461b-89dd-af0cc81912cf (a02dfc12-c914-461b-89dd-af0cc81912cf): created successfully Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f187bbc4-4625-4366-9a59-cf27d01b6999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (7f8ee822-8820-40ed-a74d-a149b2a90149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ecd1491d-c64e-49e2-bc0c-cc5c1248651d tempest-GroupSnapshotsTest-1468255330 None] Created volume successfully. Apr 21 20:53:53 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 Apr 21 20:53:53 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:53 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 0 in 1.308s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_369l4aygdevstack@QuobyteHD, size 112.00 MB, duration 1.31 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:53:53 devstack cinder-volume[82362]: INFO cinder.image.image_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Converted 112.00 MB image at 85.51 MB/s Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:53 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 1G Apr 21 20:53:53 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] GroupSnapshot 38b07d7a-5492-4b73-94e6-bdbe79d05558: creating. Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Group snapshot 38b07d7a-5492-4b73-94e6-bdbe79d05558: creating. {{(pid=82362) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:53 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946" returned: 0 in 0.698s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:53 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed 1G Apr 21 20:53:53 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 1G" returned: 0 in 0.596s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240bdc6-3b61-4b5c-8c0c-5a73f2e2964a]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:53:54 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed 1G" returned: 0 in 0.607s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91dd99d5-a21f-4772-887c-36832101b946 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91dd99d5-a21f-4772-887c-36832101b946 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed Apr 21 20:53:54 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 0 in 0.636s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:53:54 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91dd99d5-a21f-4772-887c-36832101b946 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" returned: 0 in 0.475s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed Apr 21 20:53:54 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:55 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 1 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Downloaded image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume 6a9b070e-c275-41f5-b6e9-68c16964ec40 successfully. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 for user 2bb5a99457d2412097d6704c7e20793f is deleted. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Marking volume 6a9b070e-c275-41f5-b6e9-68c16964ec40 as bootable. {{(pid=82362) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Copying metadata from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 to 6a9b070e-c275-41f5-b6e9-68c16964ec40. {{(pid=82362) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Creating volume glance metadata for volume 6a9b070e-c275-41f5-b6e9-68c16964ec40 backed by image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82362) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:53:55 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab847f92-1bd5-4c70-b30e-4ea0fe26b2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9b070e-c275-41f5-b6e9-68c16964ec40', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f61a4e-eae3-4ec2-872c-b229ac8aecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" returned: 0 in 0.460s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:55 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Volume volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 (6a9b070e-c275-41f5-b6e9-68c16964ec40): created successfully Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f61a4e-eae3-4ec2-872c-b229ac8aecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Flow 'volume_create_manager' (e13a7ff2-da3a-4fe4-827f-f63233c0f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:55 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-d8b0dc5b-34f4-4896-a137-fb7228348ee5 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Created volume successfully. Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:55 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.info Apr 21 20:53:55 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:55 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.info" returned: 0 in 0.459s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:55 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:55 devstack sudo[85593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.info Apr 21 20:53:55 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:56 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.info" returned: 0 in 0.457s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.254s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.796s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Creating offline snapshot 185703c6-e904-4a4b-9dc8-ea9519b2ee66 of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd2bb00-f12c-4a6c-a636-836abe6d95b7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:56 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1609417f-4574-451a-8dea-485814c7a2ff tempest-GroupSnapshotsV319Test-1023651372 None] group_snapshot 39553f9a-2e85-48e3-aa3d-0e031b699fcd: created successfully Apr 21 20:53:56 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:53:56 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:56 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.550s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:57 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 1G Apr 21 20:53:57 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:57 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] group_snapshot 39553f9a-2e85-48e3-aa3d-0e031b699fcd: deleting Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] group_snapshot 39553f9a-2e85-48e3-aa3d-0e031b699fcd: deleting {{(pid=82362) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Acquiring lock "cinder-quobyte-91dd99d5-a21f-4772-887c-36832101b946" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "cinder-quobyte-91dd99d5-a21f-4772-887c-36832101b946" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Acquiring lock "cinder-quobyte-d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "cinder-quobyte-d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Deleting offline snapshot d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed of volume 91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] snapshot_file for this snap is: volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a4097-2b83-4d60-8eb6-61a536ee1601]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:57 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed Apr 21 20:53:57 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:57 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 1G" returned: 0 in 0.597s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:57 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 Apr 21 20:53:57 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:57 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" returned: 0 in 0.526s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91dd99d5-a21f-4772-887c-36832101b946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b78888-f9db-424c-b763-cc7b0354678c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:57 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 Apr 21 20:53:57 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66" returned: 0 in 0.557s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:58 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 is being set with open permissions: ugo+rw Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 Apr 21 20:53:58 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946" returned: 0 in 0.532s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed Apr 21 20:53:58 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66" returned: 0 in 0.445s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.824s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Creating offline snapshot 0516539c-6cda-4f18-874a-4c8cab9b4ad8 of volume a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:58 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7a04e0ca-9c23-4ed1-a306-3fffb9e6ea16 tempest-SnapshotsActionsTest-1830799572 None] Create snapshot completed successfully Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8b71cb-eb80-431b-84c5-5f2d3e3df4ea]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack sudo[85634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf Apr 21 20:53:58 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" returned: 0 in 0.519s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed Apr 21 20:53:58 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-185703c6-e904-4a4b-9dc8-ea9519b2ee66-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-185703c6-e904-4a4b-9dc8-ea9519b2ee66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-185703c6-e904-4a4b-9dc8-ea9519b2ee66" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-185703c6-e904-4a4b-9dc8-ea9519b2ee66" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Deleting offline snapshot 185703c6-e904-4a4b-9dc8-ea9519b2ee66 of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] snapshot_file for this snap is: volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ebb669-9d1d-4c15-8c67-1b535baf6ec7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:59 devstack sudo[85641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 Apr 21 20:53:59 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:59 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf" returned: 0 in 0.597s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:59 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 1G Apr 21 20:53:59 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:59 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946.d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" returned: 0 in 0.449s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "cinder-quobyte-d7ed21b2-245c-47ad-ba3c-8dad2d55b6ed" released by "_delete_snapshot" :: held 2.094s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "cinder-quobyte-91dd99d5-a21f-4772-887c-36832101b946" released by "delete_snapshot" :: held 2.109s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:59 devstack cinder-volume[82362]: WARNING cinder.quota [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-216937920 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-216937920, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:59 devstack cinder-volume[82362]: WARNING cinder.quota [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-216937920 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-216937920, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] Created reservations ['5a2221e7-921f-4881-9e87-202c936e077e', '8fbc893f-11fe-4855-88d0-3937f1ee6fca', '4dd6e4d3-94fe-443b-9f6a-28edb774b4a9', '36f8fbc2-5d51-46b0-acc8-78753621486a'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:59 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e55279f0-79b4-4bb0-a563-c61e5f28814a tempest-GroupSnapshotsV319Test-1023651372 None] group_snapshot 39553f9a-2e85-48e3-aa3d-0e031b699fcd: deleted successfully Apr 21 20:53:59 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66" returned: 0 in 0.547s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f5bbc-b93c-4288-91cf-4b2760ff333e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:59 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:53:59 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:59 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 1G" returned: 0 in 0.550s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02dfc12-c914-461b-89dd-af0cc81912cf -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:59 devstack sudo[85657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02dfc12-c914-461b-89dd-af0cc81912cf -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 Apr 21 20:53:59 devstack sudo[85657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.509s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 Apr 21 20:54:00 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack sudo[85657]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02dfc12-c914-461b-89dd-af0cc81912cf -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8" returned: 0 in 0.469s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:00 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 Apr 21 20:54:00 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66 Apr 21 20:54:00 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Acquiring lock "cinder-quobyte-91dd99d5-a21f-4772-887c-36832101b946" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "cinder-quobyte-91dd99d5-a21f-4772-887c-36832101b946" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35c664-ed5f-4d61-8793-f9647293c4ce]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 Apr 21 20:54:00 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8" returned: 0 in 0.548s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.info Apr 21 20:54:00 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.185703c6-e904-4a4b-9dc8-ea9519b2ee66" returned: 0 in 0.431s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-185703c6-e904-4a4b-9dc8-ea9519b2ee66" released by "_delete_snapshot" :: held 2.084s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" released by "delete_snapshot" :: held 2.102s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Created reservations ['7df96c0c-d2d3-4c7b-b0a3-fa06b57edd0f', '4417f9ec-7e79-4149-8e8e-85fea439b503', 'b73a2b2e-89d4-4fa5-a1b8-a6889ab01ece', 'a012e172-c6f0-4bd8-8c5b-0bc632b60b7c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Delete snapshot completed successfully. Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f998b221-1e8b-4fb0-9e57-7c59c53b8447 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-185703c6-e904-4a4b-9dc8-ea9519b2ee66-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:01 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946" returned: 0 in 0.541s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946 Apr 21 20:54:01 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.info" returned: 0 in 0.452s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack sudo[85686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.info Apr 21 20:54:01 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91dd99d5-a21f-4772-887c-36832101b946" returned: 0 in 0.455s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "cinder-quobyte-91dd99d5-a21f-4772-887c-36832101b946" released by "delete_volume" :: held 1.029s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Created reservations ['eca2ec30-cbc8-43d0-8d3c-c47060a1659c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:01 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.info" returned: 0 in 0.446s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.126s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.618s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:01 devstack cinder-volume[82362]: WARNING cinder.quota [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-216937920 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-216937920, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12518f2-9490-4704-9220-66612143a09a]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Created reservations ['a1a16ce0-5543-40ba-bcb4-ad56e792bcd7', 'b172ece1-cfe1-4712-a1c1-d25aa11cb322', '6859dd11-4249-447e-bd03-14ad011b0c84', 'f71a704d-1fa5-48a1-b687-781aea9356db'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:01 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:54:01 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d4112f0d-112c-41a6-8470-afcefca2eb6f tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 38b07d7a-5492-4b73-94e6-bdbe79d05558: created successfully Apr 21 20:54:01 devstack sudo[85692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:01 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:02 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 0 in 0.571s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:02 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.501s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b80f809c-1bd0-418d-86de-125ff500ce0a tempest-GroupSnapshotsV319Test-1023651372 None] Delete group completed successfully. Apr 21 20:54:02 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:54:02 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:02 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:02 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:02 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 1 in 0.496s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.123s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.558s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Creating offline snapshot d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ab50cc-7841-47ad-a486-4449804121b6]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3', 'name': 'volume-6a9b070e-c275-41f5-b6e9-68c16964ec40', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d75feed-4cde-436e-b770-5b248ad4910b', 'enforce_multipath': True} {{(pid=82362) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:54:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-12c6c6c8-27c4-4d3c-8d09-11e28544cfc6 req-90cef9bc-3695-4af4-a040-4cc0b80b0eca tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] attachment_update completed successfully. Apr 21 20:54:03 devstack sudo[85706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:54:03 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:03 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.468s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:03 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.507s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:03 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 1G Apr 21 20:54:03 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:04 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 1G" returned: 0 in 0.650s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:04 devstack sudo[85716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 Apr 21 20:54:04 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:04 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" returned: 0 in 0.533s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:04 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 is being set with open permissions: ugo+rw Apr 21 20:54:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:04 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 Apr 21 20:54:04 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:05 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" returned: 0 in 0.529s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.962s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-0516539c-6cda-4f18-874a-4c8cab9b4ad8-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-0516539c-6cda-4f18-874a-4c8cab9b4ad8-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Creating volume 95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 from snapshot 0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] snapshot: 0516539c-6cda-4f18-874a-4c8cab9b4ad8, volume: 95aaf0f5-91a6-43e9-9ae5-6c4df4820c46, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:05 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-235839b9-4fd0-4373-9332-d34519dfa84b tempest-SnapshotsActionsTest-1830799572 None] Create snapshot completed successfully Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[554401b9-ade4-4529-8a79-04865e1898ec]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:05 devstack sudo[85724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 Apr 21 20:54:05 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:05 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8" returned: 0 in 0.604s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a02dfc12-c914-461b-89dd-af0cc81912cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[886022be-1d72-4c5d-933f-8acdd4dac4ef]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:05 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf Apr 21 20:54:05 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Deleting offline snapshot d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] snapshot_file for this snap is: volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45a171b-ac01-41fd-a39f-eeab500e2a84]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:06 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf" returned: 0 in 0.628s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:54:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:06 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 Apr 21 20:54:06 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:06 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 Apr 21 20:54:06 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:07 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" returned: 0 in 0.897s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[33763d4b-0f21-467e-8047-304d43ac4c78]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:07 devstack sudo[85776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:54:07 devstack sudo[85776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:10 devstack sudo[85776]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 2.775s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:10 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" returned: 0 in 3.719s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:10 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[186471dc-016d-4c9b-9f42-b5b05ca412fe]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:10 devstack sudo[85793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 Apr 21 20:54:10 devstack sudo[85793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:10 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf Apr 21 20:54:10 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:11 devstack sudo[85793]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" returned: 0 in 0.797s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:11 devstack sudo[85804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27 Apr 21 20:54:11 devstack sudo[85804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:11 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf" returned: 0 in 0.861s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf, size 1024.00 MB, duration 3.72 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:11 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Converted 1024.00 MB image at 275.14 MB/s Apr 21 20:54:11 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:11 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 Apr 21 20:54:11 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:11 devstack sudo[85804]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" returned: 0 in 0.618s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27" released by "_delete_snapshot" :: held 5.200s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" released by "delete_snapshot" :: held 5.222s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Created reservations ['92103ef0-5a7d-40fd-abec-962eab92d159', '8811bb12-eaf2-4316-bb9a-4f76a1b1fc5b', '47cb3b98-3078-4302-85a6-f1431cdb5753', 'f6654a73-d0e1-4155-a7f1-0594c1928c14'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Delete snapshot completed successfully. Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-472742b0-1ccd-4456-8ae0-446214f0ec72 tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-d9b2fb32-6e02-40b0-93d9-7ddf26aa0c27-delete_snapshot" released by "delete_snapshot" :: held 5.382s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:11 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" returned: 0 in 0.720s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" released by "_copy_volume_from_snapshot" :: held 6.607s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-0516539c-6cda-4f18-874a-4c8cab9b4ad8-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" released by "_create_volume_from_snapshot" :: held 6.634s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.659s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-bf7cd3ee-9eca-4e3b-9b07-880e61610bb2 tempest-GroupSnapshotsTest-1468255330 None] Create group from source-snapshot-38b07d7a-5492-4b73-94e6-bdbe79d05558 completed successfully. Apr 21 20:54:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Creating offline snapshot d90ed17f-c273-4ea1-ba72-0d6e70b96b63 of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f99409b-eb95-42e9-a0ec-4a75e87da97d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:12 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:54:12 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:12 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.584s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 1G Apr 21 20:54:13 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[caefa756-b080-4df8-a4f2-275116875c90]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 Apr 21 20:54:13 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:13 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 1G" returned: 0 in 0.846s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 Apr 21 20:54:13 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" returned: 0 in 0.876s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:14 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46 Apr 21 20:54:14 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63" returned: 0 in 0.720s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 is being set with open permissions: ugo+rw Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:14 devstack sudo[85834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 Apr 21 20:54:14 devstack sudo[85834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" returned: 0 in 0.617s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-95aaf0f5-91a6-43e9-9ae5-6c4df4820c46" released by "delete_volume" :: held 1.543s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['766f0571-d202-4ac4-8d19-a02d3445810f'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:14 devstack cinder-volume[82362]: WARNING cinder.quota [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1436261138 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1436261138, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:14 devstack cinder-volume[82362]: WARNING cinder.quota [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1436261138 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1436261138, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:14 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['f7a89be1-c7aa-495f-99af-602b5e20db12', '16762716-58f7-4753-ac66-700bff9b273f', '6c337d78-957e-43fd-9b29-54ed6f387816', '987d4ac6-4b4d-487c-b4ae-2da1c0287fc8'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:15 devstack sudo[85834]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63" returned: 0 in 0.531s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:15 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-17922dd1-0408-4291-8e6b-54cdb6fa4299 tempest-SnapshotsActionsTest-1830799572 None] Create snapshot completed successfully Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Flow 'volume_create_manager' (0aeae784-75c1-4d48-9ee6-ca15c54615a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8b2f91-7a03-41e5-89c0-4841c8682373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8b2f91-7a03-41e5-89c0-4841c8682373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1831403582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e347d5ba-1969-4865-b2f6-dad5d643929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3823f832ac7c42b39b1776eefd8bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:15Z,use_quota=True,user_id='78d4328489f248cf9182bb0d0390a065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35765bb-be20-425c-9a97-c3c99d513cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35765bb-be20-425c-9a97-c3c99d513cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c117c5a1-b1fe-4caf-80a8-911d04e671a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c117c5a1-b1fe-4caf-80a8-911d04e671a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e347d5ba-1969-4865-b2f6-dad5d643929a', 'volume_name': 'volume-e347d5ba-1969-4865-b2f6-dad5d643929a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4dc7d4-f5f5-485d-af02-ceff84d1de4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac4dc7d4-f5f5-485d-af02-ceff84d1de4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29c1d20-37ac-4fc5-a2ac-1adc4e832966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:15 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Volume e347d5ba-1969-4865-b2f6-dad5d643929a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e347d5ba-1969-4865-b2f6-dad5d643929a', 'volume_size': 1} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1831403582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e347d5ba-1969-4865-b2f6-dad5d643929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3823f832ac7c42b39b1776eefd8bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:15Z,use_quota=True,user_id='78d4328489f248cf9182bb0d0390a065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Creating volume e347d5ba-1969-4865-b2f6-dad5d643929a {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:15 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a 1073741824 Apr 21 20:54:15 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 38b07d7a-5492-4b73-94e6-bdbe79d05558: deleting Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 38b07d7a-5492-4b73-94e6-bdbe79d05558: deleting {{(pid=82362) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-a02dfc12-c914-461b-89dd-af0cc81912cf" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-a02dfc12-c914-461b-89dd-af0cc81912cf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-0516539c-6cda-4f18-874a-4c8cab9b4ad8" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-0516539c-6cda-4f18-874a-4c8cab9b4ad8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Deleting offline snapshot 0516539c-6cda-4f18-874a-4c8cab9b4ad8 of volume a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] snapshot_file for this snap is: volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fa0488-1335-4331-9013-6e8ff0f6b58f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-d90ed17f-c273-4ea1-ba72-0d6e70b96b63-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-d90ed17f-c273-4ea1-ba72-0d6e70b96b63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.726s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3432c0a3-66be-48a1-a0a8-9b2813ce09ef tempest-GroupSnapshotsTest-1468255330 None] Delete group completed successfully. Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Acquiring lock "cinder-quobyte-d90ed17f-c273-4ea1-ba72-0d6e70b96b63" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-d90ed17f-c273-4ea1-ba72-0d6e70b96b63" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Deleting offline snapshot d90ed17f-c273-4ea1-ba72-0d6e70b96b63 of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:15 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 Apr 21 20:54:15 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] snapshot_file for this snap is: volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0409781d-236b-4afc-98dd-577b9b755e05]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack sudo[85845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 Apr 21 20:54:15 devstack sudo[85845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a 1073741824" returned: 0 in 0.918s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:16 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a Apr 21 20:54:16 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack sudo[85845]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63" returned: 0 in 0.697s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe6a7b-8893-4e90-85f1-3a06c7daa273]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:16 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8" returned: 0 in 0.915s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a02dfc12-c914-461b-89dd-af0cc81912cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[78249d28-4b5b-4d59-adcc-e1dc50d4482c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:16 devstack sudo[85882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:54:16 devstack sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack sudo[85883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf Apr 21 20:54:16 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a" returned: 0 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b29c1d20-37ac-4fc5-a2ac-1adc4e832966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e347d5ba-1969-4865-b2f6-dad5d643929a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8a421c-3b8c-42ab-bd20-452e1ba506d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:17 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Volume volume-e347d5ba-1969-4865-b2f6-dad5d643929a (e347d5ba-1969-4865-b2f6-dad5d643929a): created successfully Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e8a421c-3b8c-42ab-bd20-452e1ba506d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Flow 'volume_create_manager' (0aeae784-75c1-4d48-9ee6-ca15c54615a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-bfa89116-f9eb-429f-a294-4c6a7383a0bd tempest-VolumeQuotasAdminTestJSON-1553680908 None] Created volume successfully. Apr 21 20:54:17 devstack sudo[85882]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.654s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf" returned: 0 in 0.606s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 Apr 21 20:54:17 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 Apr 21 20:54:17 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Acquiring lock "cinder-e347d5ba-1969-4865-b2f6-dad5d643929a-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "cinder-e347d5ba-1969-4865-b2f6-dad5d643929a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Acquiring lock "cinder-quobyte-e347d5ba-1969-4865-b2f6-dad5d643929a" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "cinder-quobyte-e347d5ba-1969-4865-b2f6-dad5d643929a" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd585d5-69fc-4353-8c33-eb9b4181aeef]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a Apr 21 20:54:17 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8" returned: 0 in 0.641s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8 Apr 21 20:54:17 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63" returned: 0 in 0.746s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:18 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63 Apr 21 20:54:18 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:18 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a" returned: 0 in 0.579s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:18 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a Apr 21 20:54:18 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:18 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.d90ed17f-c273-4ea1-ba72-0d6e70b96b63" returned: 0 in 0.526s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-d90ed17f-c273-4ea1-ba72-0d6e70b96b63" released by "_delete_snapshot" :: held 2.681s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" released by "delete_snapshot" :: held 2.701s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf.0516539c-6cda-4f18-874a-4c8cab9b4ad8" returned: 0 in 0.659s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-0516539c-6cda-4f18-874a-4c8cab9b4ad8" released by "_delete_snapshot" :: held 2.890s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-a02dfc12-c914-461b-89dd-af0cc81912cf" released by "delete_snapshot" :: held 2.915s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Created reservations ['b4f05972-f70b-4351-a15b-cba099ea2e43', '6578223c-602d-4775-b221-802c7a6e3698', '3e017879-fd4f-4ea8-83da-b509b01374c5', '8ae1c8cd-ba2a-4d91-b87a-91825fef0540'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:18 devstack cinder-volume[82362]: WARNING cinder.quota [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1436261138 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1436261138, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:18 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Delete snapshot completed successfully. Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3b79b1e5-66fb-46d5-9e0d-6210d27dcf1a tempest-SnapshotsActionsTest-1414563433 None] Lock "cinder-d90ed17f-c273-4ea1-ba72-0d6e70b96b63-delete_snapshot" released by "delete_snapshot" :: held 2.900s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['f8046976-15a6-4ff5-88f1-3fa43c0297fc', '19f1cecd-2d5d-498f-8a92-e8a56251a420', '10845a70-e3e6-4b36-85a6-8fb448d1d83d', '7631ea41-1ec8-44c6-9a84-7b29cd44c8f4'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:18 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d56d9f9c-9e96-4c59-a016-c468c93b4b9a tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 38b07d7a-5492-4b73-94e6-bdbe79d05558: deleted successfully Apr 21 20:54:18 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e347d5ba-1969-4865-b2f6-dad5d643929a" returned: 0 in 0.498s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "cinder-quobyte-e347d5ba-1969-4865-b2f6-dad5d643929a" released by "delete_volume" :: held 1.104s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Created reservations ['9f8db7dc-366f-42ac-9890-767f33b0480e', '811c3294-4bf3-4c2a-a787-0e5eedaf99f1', 'c429076a-afd6-4ed9-952f-ff94a7046a18', '75ea34e6-5779-4461-ae09-03b10cb9679a'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:18 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:18 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-a02dfc12-c914-461b-89dd-af0cc81912cf" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-a02dfc12-c914-461b-89dd-af0cc81912cf" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6487c83e-f851-4d30-80df-95c305a0a234]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf Apr 21 20:54:19 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "cinder-5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "cinder-quobyte-5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-quobyte-5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Deleting offline snapshot 5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c of volume 64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] snapshot_file for this snap is: volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df906f6-1bea-4590-8138-d7eff4a23871]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.679s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Deleted volume successfully. Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5d94d2e3-c02d-444f-84a6-7d451d0e9565 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "cinder-e347d5ba-1969-4865-b2f6-dad5d643929a-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:19 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:54:19 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:19 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf" returned: 0 in 0.533s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf Apr 21 20:54:19 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a37fe0-099e-48ea-8306-ba8e188db29b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa84a2c-e98b-4b63-9da8-238538fad92f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Flow 'volume_create_manager' (4824a7fa-69c3-46f4-97f7-20bf4010908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e150755a-ec69-41bf-ac35-4e7822408f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:20 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b Apr 21 20:54:20 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e150755a-ec69-41bf-ac35-4e7822408f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-728993998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70383126-bb3d-455a-998f-9960da8ea00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3823f832ac7c42b39b1776eefd8bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:20Z,use_quota=True,user_id='78d4328489f248cf9182bb0d0390a065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626759f9-c5c9-4fb0-99a2-98a82c7c2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626759f9-c5c9-4fb0-99a2-98a82c7c2b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568806ab-3e30-4531-8e37-dfeae01942d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568806ab-3e30-4531-8e37-dfeae01942d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70383126-bb3d-455a-998f-9960da8ea00c', 'volume_name': 'volume-70383126-bb3d-455a-998f-9960da8ea00c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33780550-9966-4cb9-b0e9-3c620403067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33780550-9966-4cb9-b0e9-3c620403067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc8637e-3870-48d8-aa30-677c32b23a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Volume 70383126-bb3d-455a-998f-9960da8ea00c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70383126-bb3d-455a-998f-9960da8ea00c', 'volume_size': 1} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-728993998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70383126-bb3d-455a-998f-9960da8ea00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3823f832ac7c42b39b1776eefd8bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:20Z,use_quota=True,user_id='78d4328489f248cf9182bb0d0390a065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Creating volume 70383126-bb3d-455a-998f-9960da8ea00c {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:20 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c 1073741824 Apr 21 20:54:20 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a02dfc12-c914-461b-89dd-af0cc81912cf" returned: 0 in 0.518s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-a02dfc12-c914-461b-89dd-af0cc81912cf" released by "delete_volume" :: held 1.108s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['000ab582-1e94-42cd-994d-17f9bae09867'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:20 devstack cinder-volume[82362]: WARNING cinder.db.sqlalchemy.api [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1436261138'] Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['c0e4f4fb-e059-42e9-8fa8-21165d88c1f5', '6cc5a405-6c34-4839-b09c-bcaffdf5eabf', '45e06223-c60b-4470-9f42-65844a8fd672', 'baf8a993-9db6-4747-9d9c-372b4ce10be8'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:20 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b" returned: 0 in 0.601s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:54:20 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c 1073741824" returned: 0 in 0.690s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c Apr 21 20:54:20 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:21 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.504s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-bfbef100-76f2-4944-8095-b0334d0444eb tempest-GroupSnapshotsTest-1468255330 None] Delete group completed successfully. Apr 21 20:54:21 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.567s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:21 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c Apr 21 20:54:21 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:21 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc8637e-3870-48d8-aa30-677c32b23a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70383126-bb3d-455a-998f-9960da8ea00c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999ccaae-75e3-4b0f-a1cf-6f0ea82e7553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Volume volume-70383126-bb3d-455a-998f-9960da8ea00c (70383126-bb3d-455a-998f-9960da8ea00c): created successfully Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999ccaae-75e3-4b0f-a1cf-6f0ea82e7553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Flow 'volume_create_manager' (4824a7fa-69c3-46f4-97f7-20bf4010908d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3c8ad145-ad27-4a3a-ba53-53c31985ddc5 tempest-VolumeQuotasAdminTestJSON-1553680908 None] Created volume successfully. Apr 21 20:54:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-188c0fa4-b1bb-4037-a61e-8c8f3df5b49e tempest-GroupSnapshotsTest-1468255330 None] Group tempest-GroupSnapshotsTest-Group-559286316: creating Apr 21 20:54:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-188c0fa4-b1bb-4037-a61e-8c8f3df5b49e tempest-GroupSnapshotsTest-1468255330 None] Group tempest-GroupSnapshotsTest-Group-559286316: created successfully Apr 21 20:54:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-188c0fa4-b1bb-4037-a61e-8c8f3df5b49e tempest-GroupSnapshotsTest-1468255330 None] Create group completed successfully. Apr 21 20:54:21 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b.5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" returned: 0 in 0.575s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-quobyte-5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c" released by "_delete_snapshot" :: held 2.344s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" released by "delete_snapshot" :: held 2.362s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Created reservations ['224220ba-0dc3-4878-acaa-568abe24300d', 'b5f48728-e723-4604-a0f4-315cee95bcea', '5f3b432d-60ec-4c11-9b26-ff8959473f33', 'b70bb07b-820b-44c4-b27d-fc785e9cdfaa'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Delete snapshot completed successfully. Apr 21 20:54:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4e5ef5c2-7635-4ea6-9f5d-08a086886d31 tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-5e4fb1c9-8baf-4cfd-bf89-0dc298ce1f6c-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "cinder-64a37fe0-099e-48ea-8306-ba8e188db29b-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-64a37fe0-099e-48ea-8306-ba8e188db29b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:22 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dff922-67d6-4234-8cac-08f5a4175e35]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-56065c12-415c-4252-aa4b-4bbd9b177a30 tempest-VolumeQuotasAdminTestJSON-1354148756 None] Transfer volume completed successfully. Apr 21 20:54:23 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b Apr 21 20:54:23 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (8b75d376-0782-416c-9966-e67ee3959aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62320279-12bf-4e6b-af29-a7e5cf22e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62320279-12bf-4e6b-af29-a7e5cf22e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140952921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ba2fc95-7090-48dc-87e8-0a8d2eb58b0a,host='devstack@QuobyteHD#QuobyteHD',id=c86c9f6c-35f8-491f-bcdb-5d44f503dbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:23Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13c91fc-e030-462d-a352-740d13ef3c40),volume_type_id=c13c91fc-e030-462d-a352-740d13ef3c40)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafad8d0-ce33-4458-b9e7-8a8e88fe765a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fafad8d0-ce33-4458-b9e7-8a8e88fe765a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cbf6db-4067-4625-90ed-fcd8e7ac8329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cbf6db-4067-4625-90ed-fcd8e7ac8329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86c9f6c-35f8-491f-bcdb-5d44f503dbff', 'volume_name': 'volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e60b7c9-c41d-4f4c-ac5d-5fd15eb614ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e60b7c9-c41d-4f4c-ac5d-5fd15eb614ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c60c1b-1f7b-4643-aefd-1cb5a5a15843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:23 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Volume c86c9f6c-35f8-491f-bcdb-5d44f503dbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff', 'volume_size': 1} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8ba2fc95-7090-48dc-87e8-0a8d2eb58b0a,created_at=2026-04-21T18:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140952921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ba2fc95-7090-48dc-87e8-0a8d2eb58b0a,host='devstack@QuobyteHD#QuobyteHD',id=c86c9f6c-35f8-491f-bcdb-5d44f503dbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:23Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13c91fc-e030-462d-a352-740d13ef3c40),volume_type_id=c13c91fc-e030-462d-a352-740d13ef3c40)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Creating volume c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:23 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff 1073741824 Apr 21 20:54:23 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:23 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b" returned: 0 in 0.899s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:23 devstack sudo[86058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b Apr 21 20:54:23 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Acquiring lock "cinder-70383126-bb3d-455a-998f-9960da8ea00c-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Lock "cinder-70383126-bb3d-455a-998f-9960da8ea00c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Acquiring lock "cinder-quobyte-70383126-bb3d-455a-998f-9960da8ea00c" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Lock "cinder-quobyte-70383126-bb3d-455a-998f-9960da8ea00c" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc149ff-eb08-4fde-8f4e-ba44a79c606b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c Apr 21 20:54:24 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-64a37fe0-099e-48ea-8306-ba8e188db29b" returned: 0 in 0.520s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-quobyte-64a37fe0-099e-48ea-8306-ba8e188db29b" released by "delete_volume" :: held 1.480s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Created reservations ['e4ae9bad-b48c-44f8-8bdc-d7729518751d', '9d1caae1-76ba-4abc-9969-dfc9f5502265', '0cc06656-f5c1-40a0-bfb7-56a02111d1a7', '3c7088ec-ea96-48b8-830f-8c54c34d135c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:24 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff 1073741824" returned: 0 in 0.792s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff Apr 21 20:54:24 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:24 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:24 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c" returned: 0 in 0.605s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c Apr 21 20:54:24 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:25 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.684s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:25 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Deleted volume successfully. Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-522aecc7-3db9-41b9-8dc7-c84fac31324c tempest-SnapshotsActionsTest-1830799572 None] Lock "cinder-64a37fe0-099e-48ea-8306-ba8e188db29b-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70383126-bb3d-455a-998f-9960da8ea00c" returned: 0 in 0.748s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Lock "cinder-quobyte-70383126-bb3d-455a-998f-9960da8ea00c" released by "delete_volume" :: held 1.410s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Created reservations ['b64387ff-295b-4f01-b326-5190e21eb181', 'aaa4ab7b-0244-4bc8-82bf-e70815bd85a9', '9e79d44b-2ff4-4e92-8831-e5051858bb6e', '6d405163-7bed-4682-9698-db8d9a32ba1d'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:25 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" returned: 0 in 1.010s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c60c1b-1f7b-4643-aefd-1cb5a5a15843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1d7389-cdb3-45af-b14f-a67c1cea9152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:25 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Volume volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff (c86c9f6c-35f8-491f-bcdb-5d44f503dbff): created successfully Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1d7389-cdb3-45af-b14f-a67c1cea9152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:25 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:25 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (8b75d376-0782-416c-9966-e67ee3959aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:25 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d3200d8a-c084-4c25-aa2c-bb74e2c53944 tempest-GroupSnapshotsTest-1468255330 None] Created volume successfully. Apr 21 20:54:26 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (7f99e3a7-53ab-4848-a407-8c2aec2e7e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194275cc-dc82-42ba-ab80-1befbf4bd7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194275cc-dc82-42ba-ab80-1befbf4bd7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-776778145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ba2fc95-7090-48dc-87e8-0a8d2eb58b0a,host='devstack@QuobyteHD#QuobyteHD',id=48e2afff-8387-4146-a3c0-11d2bc90f7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:26Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13c91fc-e030-462d-a352-740d13ef3c40),volume_type_id=c13c91fc-e030-462d-a352-740d13ef3c40)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5ce972-fee6-4d31-bf6f-6fb0897d24a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5ce972-fee6-4d31-bf6f-6fb0897d24a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6766d208-a205-4b9a-8b76-f0c539fef567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6766d208-a205-4b9a-8b76-f0c539fef567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e2afff-8387-4146-a3c0-11d2bc90f7b9', 'volume_name': 'volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab29684e-448b-48c0-b98b-b0a70861924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab29684e-448b-48c0-b98b-b0a70861924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c717b4-cc12-4704-84ef-4a8930cf6bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:26 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Volume 48e2afff-8387-4146-a3c0-11d2bc90f7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9', 'volume_size': 1} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8ba2fc95-7090-48dc-87e8-0a8d2eb58b0a,created_at=2026-04-21T18:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-776778145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ba2fc95-7090-48dc-87e8-0a8d2eb58b0a,host='devstack@QuobyteHD#QuobyteHD',id=48e2afff-8387-4146-a3c0-11d2bc90f7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:26Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13c91fc-e030-462d-a352-740d13ef3c40),volume_type_id=c13c91fc-e030-462d-a352-740d13ef3c40)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Creating volume 48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:26 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.710s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:26 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Deleted volume successfully. Apr 21 20:54:26 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 1073741824 Apr 21 20:54:26 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-299c0d7f-4c6c-4d4a-96c8-37ffc76e90f4 tempest-VolumeQuotasAdminTestJSON-199564704 None] Lock "cinder-70383126-bb3d-455a-998f-9960da8ea00c-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:27 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 1073741824" returned: 0 in 1.059s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:27 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 Apr 21 20:54:27 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:27 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9" returned: 0 in 0.596s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c717b4-cc12-4704-84ef-4a8930cf6bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37628872-4b5e-45c0-ae64-242040927d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Volume volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 (48e2afff-8387-4146-a3c0-11d2bc90f7b9): created successfully Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37628872-4b5e-45c0-ae64-242040927d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (7f99e3a7-53ab-4848-a407-8c2aec2e7e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:27 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e60b9d93-318f-4696-8355-639c5b2cb8f3 tempest-GroupSnapshotsTest-1468255330 None] Created volume successfully. Apr 21 20:54:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-85209413-0626-4109-b5cf-4c891549cba5 tempest-GroupSnapshotsTest-1468255330 None] Update group completed successfully. Apr 21 20:54:29 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-72430a75-0736-4ca2-8701-426ec452e16b tempest-GroupSnapshotsTest-1468255330 None] Update group completed successfully. Apr 21 20:54:30 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9a92a230-ea50-4ba5-a2ab-ed22187aaaaf tempest-GroupSnapshotsTest-1468255330 None] Update group completed successfully. Apr 21 20:54:32 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2b87e785-e933-4d14-835e-b3cab17ac520 tempest-GroupSnapshotsTest-1468255330 None] Update group completed successfully. Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Flow 'volume_create_manager' (627c709d-103b-4c9c-b646-1aeb8c17bdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f09c5f6-26a3-4f4b-b359-95a6c4989c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f09c5f6-26a3-4f4b-b359-95a6c4989c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-216889216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b55e52-f818-4ee2-86b1-c49434d49a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c2c9f1be4744a9af1ad61a64930c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:33Z,use_quota=True,user_id='0762ebd5db5f4f87abd117686ca3d085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(061c5fbd-63de-4f2f-8ac2-a7cffd0dee63),volume_type_id=061c5fbd-63de-4f2f-8ac2-a7cffd0dee63)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca99e832-311c-44e5-b764-de9cbf3ebdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca99e832-311c-44e5-b764-de9cbf3ebdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd16eaa-7476-412b-9bac-b2cdc7c73ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd16eaa-7476-412b-9bac-b2cdc7c73ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b55e52-f818-4ee2-86b1-c49434d49a83', 'volume_name': 'volume-55b55e52-f818-4ee2-86b1-c49434d49a83', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4362b50-fcc3-4730-a8bb-61045fc7d332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4362b50-fcc3-4730-a8bb-61045fc7d332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0ef033-6d54-4ef6-ba6e-e3c96f0a27f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:33 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Volume 55b55e52-f818-4ee2-86b1-c49434d49a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b55e52-f818-4ee2-86b1-c49434d49a83', 'volume_size': 1} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-216889216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b55e52-f818-4ee2-86b1-c49434d49a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c2c9f1be4744a9af1ad61a64930c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:33Z,use_quota=True,user_id='0762ebd5db5f4f87abd117686ca3d085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(061c5fbd-63de-4f2f-8ac2-a7cffd0dee63),volume_type_id=061c5fbd-63de-4f2f-8ac2-a7cffd0dee63)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Creating volume 55b55e52-f818-4ee2-86b1-c49434d49a83 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:33 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:33 devstack sudo[86168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 1073741824 Apr 21 20:54:33 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:33 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] GroupSnapshot dcdb4a8e-0397-4ecc-9021-bee01aeb0dde: creating. Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Group snapshot dcdb4a8e-0397-4ecc-9021-bee01aeb0dde: creating. {{(pid=82362) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:54:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:34 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 1073741824" returned: 0 in 0.764s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:34 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 Apr 21 20:54:34 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:35 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83" returned: 0 in 0.566s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.219s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0ef033-6d54-4ef6-ba6e-e3c96f0a27f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b55e52-f818-4ee2-86b1-c49434d49a83', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcfcafc-0d60-4f6e-bf56-086b77eac381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Creating offline snapshot 5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 of volume 48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85ae962-d28c-420c-9eb2-4065d3b4708e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:35 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Volume volume-55b55e52-f818-4ee2-86b1-c49434d49a83 (55b55e52-f818-4ee2-86b1-c49434d49a83): created successfully Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcfcafc-0d60-4f6e-bf56-086b77eac381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Flow 'volume_create_manager' (627c709d-103b-4c9c-b646-1aeb8c17bdc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:35 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-b88c1709-ccd9-496b-9357-ee57d7dfc9cd tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Terminate volume connection completed successfully. Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-b88c1709-ccd9-496b-9357-ee57d7dfc9cd tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Deleting attachment 2d75feed-4cde-436e-b770-5b248ad4910b. {{(pid=82362) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:54:35 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-362c9a37-7aad-4b91-a0c4-f63886832d4e tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Created volume successfully. Apr 21 20:54:35 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 Apr 21 20:54:35 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "cinder-6a9b070e-c275-41f5-b6e9-68c16964ec40-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-6a9b070e-c275-41f5-b6e9-68c16964ec40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:35 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9" returned: 0 in 0.620s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:35 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 1G Apr 21 20:54:35 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "cinder-quobyte-6a9b070e-c275-41f5-b6e9-68c16964ec40" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-quobyte-6a9b070e-c275-41f5-b6e9-68c16964ec40" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[083cda4b-ad57-471d-b311-3b0a3aaabd6c]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:35 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:54:35 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:36 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 1G" returned: 0 in 0.769s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 0 in 0.688s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:36 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 Apr 21 20:54:36 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:54:36 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:36 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.670s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:36 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:36 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-de7a2bdf-e027-4dac-a7f2-fd6cd1a9dbd4 tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Retype volume completed successfully. Apr 21 20:54:37 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" returned: 0 in 0.575s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:37 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 1 in 0.574s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 Apr 21 20:54:37 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:37 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40 Apr 21 20:54:37 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Acquiring lock "cinder-55b55e52-f818-4ee2-86b1-c49434d49a83-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "cinder-55b55e52-f818-4ee2-86b1-c49434d49a83-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Acquiring lock "cinder-quobyte-55b55e52-f818-4ee2-86b1-c49434d49a83" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "cinder-quobyte-55b55e52-f818-4ee2-86b1-c49434d49a83" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a65e2-48a0-4f2f-ba65-87603a262506]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 Apr 21 20:54:37 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:37 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a9b070e-c275-41f5-b6e9-68c16964ec40" returned: 0 in 0.536s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-quobyte-6a9b070e-c275-41f5-b6e9-68c16964ec40" released by "delete_volume" :: held 1.858s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:37 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" returned: 0 in 0.610s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.quota [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Created reservations ['80e24e4c-987c-4f35-909c-e306b169491c', '737683a8-6c14-4abf-a49e-f975e8ad3599', '572a00a6-53e6-4c9e-a06d-de0a2778ead5', 'b8ca2569-0de4-4cf7-bc3e-0b2f55b4eafa'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:37 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.info Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:37 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:37 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:37 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83" returned: 0 in 0.622s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83 Apr 21 20:54:38 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.info" returned: 0 in 0.517s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.info Apr 21 20:54:38 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.537s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG cinder.manager [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:38 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Deleted volume successfully. Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-469daeef-fe27-43d6-9c7e-7ed2a6379142 req-9bbc6eda-be8a-4215-a81b-f0cbdb0c1f75 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-6a9b070e-c275-41f5-b6e9-68c16964ec40-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:38 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-55b55e52-f818-4ee2-86b1-c49434d49a83" returned: 0 in 0.565s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "cinder-quobyte-55b55e52-f818-4ee2-86b1-c49434d49a83" released by "delete_volume" :: held 1.217s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:38 devstack cinder-volume[82362]: WARNING cinder.quota [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:38 devstack cinder-volume[82362]: WARNING cinder.quota [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Created reservations ['bbf4a34c-5a47-4413-a44c-1e5740b5277b', '9b80ee90-8e78-46a7-90e6-64a3c987e42c', '71fe5fc7-dc8a-4af4-9031-5bab2488da8b', '28a10d52-ee92-48ea-8ceb-100cb35cfd0e'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:38 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.info" returned: 0 in 0.527s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:38 devstack sudo[86230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:38 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.741s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Creating offline snapshot e215c681-72ab-476f-84c6-a7e8ce1de214 of volume c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdecc71-58d2-41f3-9d0a-1824cff87e39]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:38 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff Apr 21 20:54:38 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:39 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.485s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Deleted volume successfully. Apr 21 20:54:39 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0f633e42-0fc7-4876-8deb-16d9c95a393d tempest-VolumeRetypeWithoutMigrationTest-1543936885 None] Lock "cinder-55b55e52-f818-4ee2-86b1-c49434d49a83-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:39 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" returned: 0 in 0.674s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:39 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 1G Apr 21 20:54:39 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:40 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 1G" returned: 0 in 0.586s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:40 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 Apr 21 20:54:40 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:40 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214" returned: 0 in 0.682s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:40 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:40 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 Apr 21 20:54:40 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:41 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214" returned: 0 in 0.649s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:41 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.info Apr 21 20:54:41 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:42 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.info" returned: 0 in 0.631s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:42 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:42 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.info Apr 21 20:54:42 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Flow 'volume_create_manager' (65a67993-a263-4a08-8828-e852a88bb2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd690fc3-aa5b-49cd-86ea-9cd4c4ac0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd690fc3-aa5b-49cd-86ea-9cd4c4ac0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-944385868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ff9483aafc4c91baa62e9653373211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:42Z,use_quota=True,user_id='9ee6e05b7075492aa7640e36b6be20c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5396eecc-63e0-4f38-bc12-8e84b29da6b7),volume_type_id=5396eecc-63e0-4f38-bc12-8e84b29da6b7)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df98af2-b6e5-4956-9ab8-e94e93492d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df98af2-b6e5-4956-9ab8-e94e93492d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4267e3c1-8efd-42ab-8dc8-751fa8ac985a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4267e3c1-8efd-42ab-8dc8-751fa8ac985a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9', 'volume_name': 'volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef3ef3-cd10-4588-962d-cd733e998e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef3ef3-cd10-4588-962d-cd733e998e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce433833-328b-493b-a71b-f53aabe265af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:42 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Volume b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9', 'volume_size': 1} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:42 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.info" returned: 0 in 0.638s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.940s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.230s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-944385868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14ff9483aafc4c91baa62e9653373211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:42Z,use_quota=True,user_id='9ee6e05b7075492aa7640e36b6be20c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5396eecc-63e0-4f38-bc12-8e84b29da6b7),volume_type_id=5396eecc-63e0-4f38-bc12-8e84b29da6b7)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Creating volume b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:42 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:42 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 1073741824 Apr 21 20:54:42 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:42 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-efc9397d-69e4-4372-8a62-40fc56d43743 tempest-GroupSnapshotsTest-1468255330 None] group_snapshot dcdb4a8e-0397-4ecc-9021-bee01aeb0dde: created successfully Apr 21 20:54:43 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] group_snapshot dcdb4a8e-0397-4ecc-9021-bee01aeb0dde: deleting Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] group_snapshot dcdb4a8e-0397-4ecc-9021-bee01aeb0dde: deleting {{(pid=82362) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-48e2afff-8387-4146-a3c0-11d2bc90f7b9" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-48e2afff-8387-4146-a3c0-11d2bc90f7b9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Deleting offline snapshot 5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 of volume 48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] snapshot_file for this snap is: volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64918ab-0697-4b30-9d1a-5e28ecc67f36]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:43 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 Apr 21 20:54:43 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:43 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 1073741824" returned: 0 in 0.882s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:43 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 Apr 21 20:54:43 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" returned: 0 in 0.694s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf398652-0e94-4054-abd3-bda01b3accca]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce433833-328b-493b-a71b-f53aabe265af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030303ad-9a06-4f38-8920-1a54457faaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Volume volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 (b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9): created successfully Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030303ad-9a06-4f38-8920-1a54457faaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Flow 'volume_create_manager' (65a67993-a263-4a08-8828-e852a88bb2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-df1344e2-7fd3-4ca6-802a-aefa2d7b9e67 tempest-VolumeTypesAccessTest-990173713 None] Created volume successfully. Apr 21 20:54:44 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 Apr 21 20:54:44 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Flow 'volume_create_manager' (9c5a6ff1-471f-4f56-b5fa-0729b30891bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95de4336-e1d5-4189-bc62-34c2d6fa08d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95de4336-e1d5-4189-bc62-34c2d6fa08d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1362779424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a747b28e-8ede-45b8-9007-4f8b1fce8f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0408c395c6d143578364368fb2ad49cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:44Z,use_quota=True,user_id='c5172e78dbe742b0a42bafb874f52698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78965119-d833-4ce6-974a-202cc5e7b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78965119-d833-4ce6-974a-202cc5e7b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17048f36-da1f-432a-8a7d-9986c6e10ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17048f36-da1f-432a-8a7d-9986c6e10ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a747b28e-8ede-45b8-9007-4f8b1fce8f1f', 'volume_name': 'volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05133eaa-fffd-4ea4-89e1-7c5ad3034d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05133eaa-fffd-4ea4-89e1-7c5ad3034d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf0c756-4153-44cf-8bd9-c6d256d8f494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Volume a747b28e-8ede-45b8-9007-4f8b1fce8f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f', 'volume_size': 1} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1362779424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a747b28e-8ede-45b8-9007-4f8b1fce8f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0408c395c6d143578364368fb2ad49cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:44Z,use_quota=True,user_id='c5172e78dbe742b0a42bafb874f52698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Creating volume a747b28e-8ede-45b8-9007-4f8b1fce8f1f {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:44 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[86302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f 1073741824 Apr 21 20:54:44 devstack sudo[86302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Acquiring lock "cinder-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Lock "cinder-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Acquiring lock "cinder-quobyte-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Lock "cinder-quobyte-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4270316-3b53-4f90-96fa-8832f55991a9]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 Apr 21 20:54:44 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9" returned: 0 in 0.667s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 Apr 21 20:54:44 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[86302]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f 1073741824" returned: 0 in 0.579s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f Apr 21 20:54:45 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9" returned: 0 in 0.602s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9 Apr 21 20:54:45 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" returned: 0 in 0.635s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3 Apr 21 20:54:45 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f" returned: 0 in 0.593s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf0c756-4153-44cf-8bd9-c6d256d8f494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd25ebb8-1564-41c7-85d4-7e23fb755b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Volume volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f (a747b28e-8ede-45b8-9007-4f8b1fce8f1f): created successfully Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd25ebb8-1564-41c7-85d4-7e23fb755b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Flow 'volume_create_manager' (9c5a6ff1-471f-4f56-b5fa-0729b30891bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3b8192dd-67e7-4013-b56a-f861e16b5976 tempest-VolumesListAdminTestJSON-1969216901 None] Created volume successfully. Apr 21 20:54:45 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9" returned: 0 in 0.529s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Lock "cinder-quobyte-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9" released by "delete_volume" :: held 1.155s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:45 devstack cinder-volume[82362]: WARNING cinder.quota [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1289336806 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1289336806, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:45 devstack cinder-volume[82362]: WARNING cinder.quota [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1289336806 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1289336806, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Created reservations ['88b2cd89-4f5b-4a9f-ad93-9abda18e8b0c', 'efc72d88-002c-4224-803d-b9e87ca66f24', 'ae8238e8-6ab2-4344-b905-a2f57465f6ac', 'a7ae39b3-1cf7-4a40-bae8-35323aa967cc'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:46 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:46 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9.5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" returned: 0 in 0.524s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-5bbf0ebd-bc26-41f7-b3f3-85ca992f46a3" released by "_delete_snapshot" :: held 2.610s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-48e2afff-8387-4146-a3c0-11d2bc90f7b9" released by "delete_snapshot" :: held 2.647s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-e215c681-72ab-476f-84c6-a7e8ce1de214" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-e215c681-72ab-476f-84c6-a7e8ce1de214" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Deleting offline snapshot e215c681-72ab-476f-84c6-a7e8ce1de214 of volume c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] snapshot_file for this snap is: volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ebd789-6d73-46a7-a78e-137decfef323]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:46 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 Apr 21 20:54:46 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:46 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Deleted volume successfully. Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cfe87379-5d32-4e5e-b06b-ea22231bff88 tempest-VolumeTypesAccessTest-990173713 None] Lock "cinder-b1dfe68a-5bd2-49ad-a1b3-1adfbb1e87f9-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:46 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214" returned: 0 in 0.640s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5a1f22-b963-4b25-9cc0-b38998626dcc]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:46 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff Apr 21 20:54:46 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Flow 'volume_create_manager' (6fa1ad2d-858a-4db2-aa31-89fcc6a1e787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7fe9e7-6d4c-4a23-9ca5-ea50bfab2f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7fe9e7-6d4c-4a23-9ca5-ea50bfab2f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-192250469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c562d6a-3082-4929-bcb9-f15b0ed315fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0408c395c6d143578364368fb2ad49cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:47Z,use_quota=True,user_id='c5172e78dbe742b0a42bafb874f52698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61e0cc6-53ae-4a02-9a9f-85ecb4030980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61e0cc6-53ae-4a02-9a9f-85ecb4030980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfde452-1364-4b87-a24d-e32041abca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfde452-1364-4b87-a24d-e32041abca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c562d6a-3082-4929-bcb9-f15b0ed315fd', 'volume_name': 'volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d0cd48-b898-4c83-8869-e0449306bc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d0cd48-b898-4c83-8869-e0449306bc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901b14b4-d994-4bdd-ac23-8fdc6f62a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:47 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Volume 0c562d6a-3082-4929-bcb9-f15b0ed315fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd', 'volume_size': 1} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-192250469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c562d6a-3082-4929-bcb9-f15b0ed315fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0408c395c6d143578364368fb2ad49cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:47Z,use_quota=True,user_id='c5172e78dbe742b0a42bafb874f52698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Creating volume 0c562d6a-3082-4929-bcb9-f15b0ed315fd {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:47 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd 1073741824 Apr 21 20:54:47 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" returned: 0 in 0.839s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 Apr 21 20:54:47 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd 1073741824" returned: 0 in 0.595s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd Apr 21 20:54:47 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:48 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214" returned: 0 in 0.619s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:48 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214 Apr 21 20:54:48 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:48 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd" returned: 0 in 0.598s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901b14b4-d994-4bdd-ac23-8fdc6f62a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b81715-b9f4-45fc-beb2-b1095e0b66c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:48 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Volume volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd (0c562d6a-3082-4929-bcb9-f15b0ed315fd): created successfully Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b81715-b9f4-45fc-beb2-b1095e0b66c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Flow 'volume_create_manager' (6fa1ad2d-858a-4db2-aa31-89fcc6a1e787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:48 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fdde2063-882f-4c91-a4e0-098ea4c65b82 tempest-VolumesListAdminTestJSON-1969216901 None] Created volume successfully. Apr 21 20:54:48 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff.e215c681-72ab-476f-84c6-a7e8ce1de214" returned: 0 in 0.514s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-e215c681-72ab-476f-84c6-a7e8ce1de214" released by "_delete_snapshot" :: held 2.698s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" released by "delete_snapshot" :: held 2.716s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:48 devstack cinder-volume[82362]: WARNING cinder.quota [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1137658814 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1137658814, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:48 devstack cinder-volume[82362]: WARNING cinder.quota [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1137658814 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1137658814, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:48 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['0c8f0951-7398-41cb-b04d-599e08254fbf', 'fccf94d3-b5c3-4442-9a44-29640c82ab76', '81536dba-1fff-47b8-86fe-aefbbb74803c', 'ec8d6e6b-8ace-4c48-a491-47d0062c1803'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['dd9b413e-92cb-41fc-809e-b9f3c2fac518', 'f7762f03-39bc-4bcd-844b-2a2ee7c156e1', '186fd608-f56d-4232-ab5b-aa305bda4e72', 'e26f0634-4257-4acb-8a49-abcd653d983f'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9e5424de-bf4d-46a6-b5c0-650886035d02 tempest-GroupSnapshotsTest-1468255330 None] group_snapshot dcdb4a8e-0397-4ecc-9021-bee01aeb0dde: deleted successfully Apr 21 20:54:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-48461e66-855b-424f-adc2-e4e89c57e446 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Terminate volume connection completed successfully. Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-48461e66-855b-424f-adc2-e4e89c57e446 tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Deleting attachment 51f0ca30-71c2-4520-b639-f37062b17030. {{(pid=82362) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Flow 'volume_create_manager' (00869e8c-e0bf-49f1-b71a-bb768714e49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484fb911-9475-445f-a57f-3c39ac559e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484fb911-9475-445f-a57f-3c39ac559e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-853468442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c9870c-bfe7-45fc-b05a-0c6b0ef050e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0408c395c6d143578364368fb2ad49cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:50Z,use_quota=True,user_id='c5172e78dbe742b0a42bafb874f52698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d1c489-2c03-4c4a-b8af-b38f295921fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d1c489-2c03-4c4a-b8af-b38f295921fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ce3a74-d0a8-4292-9e81-33def2a66d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ce3a74-d0a8-4292-9e81-33def2a66d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c9870c-bfe7-45fc-b05a-0c6b0ef050e1', 'volume_name': 'volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8412ac4f-94d7-4f0c-9fa3-dd58397fd7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8412ac4f-94d7-4f0c-9fa3-dd58397fd7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd5be54-fcae-4fe7-9435-0456985b2b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Volume 35c9870c-bfe7-45fc-b05a-0c6b0ef050e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1', 'volume_size': 1} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-853468442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c9870c-bfe7-45fc-b05a-0c6b0ef050e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0408c395c6d143578364368fb2ad49cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:50Z,use_quota=True,user_id='c5172e78dbe742b0a42bafb874f52698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Creating volume 35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:49 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 1073741824 Apr 21 20:54:49 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-48e2afff-8387-4146-a3c0-11d2bc90f7b9" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-48e2afff-8387-4146-a3c0-11d2bc90f7b9" acquired by "delete_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ce90e5-c7f6-42c7-a8bd-eeacebed8ce5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "cinder-823e0f29-648d-4945-8e02-c86f28902cea-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:50 devstack sudo[86393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 Apr 21 20:54:50 devstack sudo[86393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-823e0f29-648d-4945-8e02-c86f28902cea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "cinder-quobyte-823e0f29-648d-4945-8e02-c86f28902cea" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-quobyte-823e0f29-648d-4945-8e02-c86f28902cea" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[457e3ba3-a126-4eee-aef0-ea33810593d7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 1073741824" returned: 0 in 0.723s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea Apr 21 20:54:50 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 Apr 21 20:54:50 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack sudo[86393]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9" returned: 0 in 0.612s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9 Apr 21 20:54:50 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea" returned: 0 in 0.675s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1" returned: 0 in 0.607s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:51 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea Apr 21 20:54:51 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd5be54-fcae-4fe7-9435-0456985b2b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f647109-676b-4a4f-b389-547d4ac1ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=200,cinder:UPDATE=189,cinder:INSERT=43,cinder:DELETE=7 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:51 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Volume volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 (35c9870c-bfe7-45fc-b05a-0c6b0ef050e1): created successfully Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f647109-676b-4a4f-b389-547d4ac1ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Flow 'volume_create_manager' (00869e8c-e0bf-49f1-b71a-bb768714e49c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:51 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-195edc78-55d3-4cc4-a55b-2edb936aa2a4 tempest-VolumesListAdminTestJSON-1969216901 None] Created volume successfully. Apr 21 20:54:51 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48e2afff-8387-4146-a3c0-11d2bc90f7b9" returned: 0 in 0.568s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-48e2afff-8387-4146-a3c0-11d2bc90f7b9" released by "delete_volume" :: held 1.230s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b27e4f6-7842-42a7-b955-d65c040db648]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff Apr 21 20:54:51 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-823e0f29-648d-4945-8e02-c86f28902cea" returned: 0 in 0.527s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-quobyte-823e0f29-648d-4945-8e02-c86f28902cea" released by "delete_volume" :: held 1.227s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.quota [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Created reservations ['8086f96a-b3a4-4dbb-bc99-cdb17daedd69', '24a9e38b-895e-4561-9f4f-95036611c3af', '8752b83a-0cbe-43b8-86f5-5dbd6473a28b', '1c6f07e3-cc61-4113-afcf-92b794a55c53'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:51 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" returned: 0 in 0.635s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:52 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff Apr 21 20:54:52 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.513s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.manager [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Deleted volume successfully. Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=188,cinder:UPDATE=195,cinder:INSERT=60,cinder:DELETE=13 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [req-7d257169-0e41-425e-8db0-6f06fd8c2aa4 req-fa449414-a04f-4eeb-a0f6-2fc2a8d89bbf tempest-ServerBootFromVolumeStableRescueTest-1697884350 None] Lock "cinder-823e0f29-648d-4945-8e02-c86f28902cea-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Flow 'volume_create_manager' (6854b501-7ce5-4afb-8bbd-fedbedfb5096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1506582d-6f72-4776-b0d0-40e8e9cbcdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1506582d-6f72-4776-b0d0-40e8e9cbcdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00ff1f7-a784-44ed-9baa-f6a2feb3469e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182cf2042226454fa667a565101cbd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='fa94009ebf7d46b184b9a144f25b88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3110fe96-c5b6-4644-b3e8-e8d3a0f94adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3110fe96-c5b6-4644-b3e8-e8d3a0f94adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be00827-794b-4dab-8af2-8c2be3d64653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be00827-794b-4dab-8af2-8c2be3d64653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00ff1f7-a784-44ed-9baa-f6a2feb3469e', 'volume_name': 'volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbc7e81-0357-471e-9ecf-d29411d1133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbc7e81-0357-471e-9ecf-d29411d1133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2c4808-9d06-4166-9376-8588434ff09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:52 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Volume e00ff1f7-a784-44ed-9baa-f6a2feb3469e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e', 'volume_size': 1} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00ff1f7-a784-44ed-9baa-f6a2feb3469e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182cf2042226454fa667a565101cbd15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='fa94009ebf7d46b184b9a144f25b88f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Creating volume e00ff1f7-a784-44ed-9baa-f6a2feb3469e {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:52 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:52 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e 1073741824 Apr 21 20:54:52 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" returned: 0 in 0.572s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-c86c9f6c-35f8-491f-bcdb-5d44f503dbff" released by "delete_volume" :: held 1.268s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['90abf8ea-9a84-49b9-aad4-8f780b183076'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:52 devstack cinder-volume[82362]: WARNING cinder.quota [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1137658814 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1137658814, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['da553bb2-ea8e-4ed4-91ac-859d1ce2e1d9', '940e50c5-0e9f-40cf-8819-20371c73683d', '924cb9e5-f6d0-45fa-943e-2d332695f71d', '834be424-1e8e-4192-bbae-41118d8bf1d6'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['ea06e751-d459-4f40-a602-ef1da31fa309', 'acf3ced7-3d6e-4326-80b3-46808af04208', '7279fc54-cda1-4956-a0d8-099679aad388', '01c0b85b-d1aa-4062-8dd2-cbab9e860db5'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:52 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:52 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e 1073741824" returned: 0 in 0.660s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e Apr 21 20:54:53 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.630s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-23585bfa-aaf0-45fd-ab25-8f69021b8d5f tempest-GroupSnapshotsTest-1468255330 None] Delete group completed successfully. Apr 21 20:54:53 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e" returned: 0 in 0.689s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2c4808-9d06-4166-9376-8588434ff09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b907d6c-3ac8-4f7f-84ad-804f216d3e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:53 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Volume volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e (e00ff1f7-a784-44ed-9baa-f6a2feb3469e): created successfully Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b907d6c-3ac8-4f7f-84ad-804f216d3e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Flow 'volume_create_manager' (6854b501-7ce5-4afb-8bbd-fedbedfb5096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ac1caf15-881c-4cae-9037-681a9432e6d0 tempest-GroupSnapshotsTest-1468255330 None] Group tempest-GroupSnapshotsTest-Group-1306147446: creating Apr 21 20:54:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2cd45769-a638-4be0-9a1c-b8b15c19d81a tempest-VolumesListAdminTestJSON-148147273 None] Created volume successfully. Apr 21 20:54:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ac1caf15-881c-4cae-9037-681a9432e6d0 tempest-GroupSnapshotsTest-1468255330 None] Group tempest-GroupSnapshotsTest-Group-1306147446: created successfully Apr 21 20:54:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ac1caf15-881c-4cae-9037-681a9432e6d0 tempest-GroupSnapshotsTest-1468255330 None] Create group completed successfully. Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Acquiring lock "cinder-e00ff1f7-a784-44ed-9baa-f6a2feb3469e-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Lock "cinder-e00ff1f7-a784-44ed-9baa-f6a2feb3469e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Acquiring lock "cinder-quobyte-e00ff1f7-a784-44ed-9baa-f6a2feb3469e" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Lock "cinder-quobyte-e00ff1f7-a784-44ed-9baa-f6a2feb3469e" acquired by "delete_volume" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c1e4d-a863-4338-9deb-f78cf89f6b89]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "cinder-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:54 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e Apr 21 20:54:54 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "cinder-quobyte-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-quobyte-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a6004e-512d-4399-94e7-3c152922d466]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 Apr 21 20:54:54 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e" returned: 0 in 0.784s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:55 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e Apr 21 20:54:55 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (105c1a2c-1544-4ea0-a50b-e6b49e8e9923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee656acc-ad24-49c3-b0c6-212015669849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee656acc-ad24-49c3-b0c6-212015669849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1694346393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99934e6c-3ae4-4682-ab2b-fe269ecd63b2,host='devstack@QuobyteHD#QuobyteHD',id=379a3a70-374c-45c4-bc0b-d187f4b03427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:55Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f383fca9-9bef-46e1-b760-62bc2de8bdec),volume_type_id=f383fca9-9bef-46e1-b760-62bc2de8bdec)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09feac2d-d23a-44b0-b779-8d50f1874428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09feac2d-d23a-44b0-b779-8d50f1874428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8dd8001-7e43-4b67-84e9-dc21b57fc737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8dd8001-7e43-4b67-84e9-dc21b57fc737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379a3a70-374c-45c4-bc0b-d187f4b03427', 'volume_name': 'volume-379a3a70-374c-45c4-bc0b-d187f4b03427', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3690213f-4b75-4285-b9e3-570394e509e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3690213f-4b75-4285-b9e3-570394e509e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3c414c-2f17-411b-8a93-1afc2c4d0727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:55 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Volume 379a3a70-374c-45c4-bc0b-d187f4b03427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379a3a70-374c-45c4-bc0b-d187f4b03427', 'volume_size': 1} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99934e6c-3ae4-4682-ab2b-fe269ecd63b2,created_at=2026-04-21T18:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1694346393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99934e6c-3ae4-4682-ab2b-fe269ecd63b2,host='devstack@QuobyteHD#QuobyteHD',id=379a3a70-374c-45c4-bc0b-d187f4b03427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec83398dc38d42b0a01a513a8ecd9f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:55Z,use_quota=True,user_id='25ad11c31d6745ae9d332c943a6885a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f383fca9-9bef-46e1-b760-62bc2de8bdec),volume_type_id=f383fca9-9bef-46e1-b760-62bc2de8bdec)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Creating volume 379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:55 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1" returned: 0 in 0.809s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 1073741824 Apr 21 20:54:55 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1 Apr 21 20:54:55 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e00ff1f7-a784-44ed-9baa-f6a2feb3469e" returned: 0 in 0.709s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Lock "cinder-quobyte-e00ff1f7-a784-44ed-9baa-f6a2feb3469e" released by "delete_volume" :: held 1.521s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:56 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1" returned: 0 in 0.621s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Created reservations ['d6ede328-0253-44cd-b170-0d5798100a7e', '0a68c4ba-5a15-4b47-987b-4645435801c8', '642ec0a1-90d3-4c2f-941e-334002dbe81e', 'cf26ea5f-7d36-4ac1-9f6b-c3b1a40d5d72'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-quobyte-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1" released by "delete_volume" :: held 1.487s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:56 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 1073741824" returned: 0 in 0.693s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 Apr 21 20:54:56 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Created reservations ['01a0025c-1031-4994-99e9-be846e49e4c9', '78e89412-4b73-4a2e-be94-9b6259884045', 'a05749d4-c822-4fe1-9d9c-10957e2647ca', 'bcd1410f-f057-4bc6-874d-2b4808b987ee'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:56 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:56 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:56 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.599s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:56 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Deleted volume successfully. Apr 21 20:54:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-24b8a7e6-5be8-4b93-b823-c9f31d55065e tempest-VolumesListAdminTestJSON-148147273 None] Lock "cinder-e00ff1f7-a784-44ed-9baa-f6a2feb3469e-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:57 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427" returned: 0 in 0.686s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3c414c-2f17-411b-8a93-1afc2c4d0727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379a3a70-374c-45c4-bc0b-d187f4b03427', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be75026-2b65-480c-8d27-929dfc9b28b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:57 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Volume volume-379a3a70-374c-45c4-bc0b-d187f4b03427 (379a3a70-374c-45c4-bc0b-d187f4b03427): created successfully Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be75026-2b65-480c-8d27-929dfc9b28b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Flow 'volume_create_manager' (105c1a2c-1544-4ea0-a50b-e6b49e8e9923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:57 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-06504c0d-ef42-4774-b4fb-7653b1a3be57 tempest-GroupSnapshotsTest-1468255330 None] Created volume successfully. Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "cinder-0c562d6a-3082-4929-bcb9-f15b0ed315fd-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-0c562d6a-3082-4929-bcb9-f15b0ed315fd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "cinder-quobyte-0c562d6a-3082-4929-bcb9-f15b0ed315fd" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:57 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.696s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-quobyte-0c562d6a-3082-4929-bcb9-f15b0ed315fd" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:57 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Deleted volume successfully. Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9694ac-efa5-4a19-a53d-e7fb50c0cc56]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-34c80343-8df2-497d-9e9e-02b1ab94b52e tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-35c9870c-bfe7-45fc-b05a-0c6b0ef050e1-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:57 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd Apr 21 20:54:57 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Flow 'volume_create_manager' (abbb65e0-0198-40d0-b1d6-c2d4c4e27a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6a2ce9-ea27-4569-819e-cbdb096a6be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6a2ce9-ea27-4569-819e-cbdb096a6be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-797866665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6095f48-c87f-48b0-8818-27634ca4dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33920edb98c14a4293483590db9dde51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:58Z,use_quota=True,user_id='3f648bad65d9443a84e1b49ddcef1b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0b219f-ccb3-4eca-b99a-4938ed2fbf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0b219f-ccb3-4eca-b99a-4938ed2fbf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc3c06e-1887-4369-b852-10ad22af9756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.image.glance [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Creating Keystone auth plugin from conf {{(pid=82362) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:54:57 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd" returned: 0 in 0.592s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:57 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd Apr 21 20:54:57 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc3c06e-1887-4369-b852-10ad22af9756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6095f48-c87f-48b0-8818-27634ca4dfc6', 'volume_name': 'volume-b6095f48-c87f-48b0-8818-27634ca4dfc6', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1396046-ba51-4197-8d48-e340931263da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1396046-ba51-4197-8d48-e340931263da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c428b0-5ef8-4201-8c33-cded9c0a3859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:57 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Volume b6095f48-c87f-48b0-8818-27634ca4dfc6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6095f48-c87f-48b0-8818-27634ca4dfc6', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Trying to clone b6095f48-c87f-48b0-8818-27634ca4dfc6 from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]). {{(pid=82362) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:54:57 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] GroupSnapshot 23dd7479-e633-4098-a8b5-05affe5a96a1: creating. Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Group snapshot 23dd7479-e633-4098-a8b5-05affe5a96a1: creating. {{(pid=82362) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Creating offline snapshot 52ee4e26-dd97-4176-94cf-d558dbc13264 of volume 379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b229fb44-771f-4a9f-8934-6ed0333f6242]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:54:58 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:54:58 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 Apr 21 20:54:58 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab43e7-1db8-4833-ae50-49bd2ec30647]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD Apr 21 20:54:58 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0c562d6a-3082-4929-bcb9-f15b0ed315fd" returned: 0 in 0.544s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-quobyte-0c562d6a-3082-4929-bcb9-f15b0ed315fd" released by "delete_volume" :: held 1.161s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Created reservations ['a5df32a8-65e1-4aad-ace6-7c4fc56b5c89', 'bbefdc15-201d-4b02-84e4-85f4d901872c', 'be040073-858c-4d11-9e52-e5176098663f', 'e3cfdac4-9f97-49c3-adac-0eb1510ad935'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:54:58 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427" returned: 0 in 0.582s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 1G Apr 21 20:54:58 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD" returned: 0 in 0.510s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 is fetched for user 3f648bad65d9443a84e1b49ddcef1b90. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf46094-6dfd-4f12-8d9a-e208d7bcd965]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD Apr 21 20:54:58 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.450s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:58 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Deleted volume successfully. Apr 21 20:54:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d97ce88-40fa-4b3e-a0f4-ebddc56902e3 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-0c562d6a-3082-4929-bcb9-f15b0ed315fd-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:59 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 1G" returned: 0 in 0.548s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a3a70-374c-45c4-bc0b-d187f4b03427 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a3a70-374c-45c4-bc0b-d187f4b03427 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 Apr 21 20:54:59 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "cinder-a747b28e-8ede-45b8-9007-4f8b1fce8f1f-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-a747b28e-8ede-45b8-9007-4f8b1fce8f1f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "cinder-quobyte-a747b28e-8ede-45b8-9007-4f8b1fce8f1f" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-quobyte-a747b28e-8ede-45b8-9007-4f8b1fce8f1f" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3316c1a9-c6b6-4724-b890-eb048fbeded1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f Apr 21 20:54:59 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a3a70-374c-45c4-bc0b-d187f4b03427 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264" returned: 0 in 0.485s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 Apr 21 20:54:59 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f" returned: 0 in 0.511s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f Apr 21 20:54:59 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264" returned: 0 in 0.439s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.info Apr 21 20:55:00 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a747b28e-8ede-45b8-9007-4f8b1fce8f1f" returned: 0 in 0.416s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-quobyte-a747b28e-8ede-45b8-9007-4f8b1fce8f1f" released by "delete_volume" :: held 0.965s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Created reservations ['8f0541ef-cd7d-4777-b58e-42ba43e1ac7d', 'b49f2f54-fa53-4530-b4c2-a5197ed3269c', '44380681-1bc7-450a-8dff-ebafe423a09f', '62af692a-9d86-4f11-a56d-2e1db8b7818d'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:00 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.info" returned: 0 in 0.476s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:55:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.info Apr 21 20:55:00 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.560s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Deleted volume successfully. Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-96b6bd0a-ec15-4a3c-9e71-a9c584ae9396 tempest-VolumesListAdminTestJSON-1969216901 None] Lock "cinder-a747b28e-8ede-45b8-9007-4f8b1fce8f1f-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:01 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.info" returned: 0 in 0.590s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.190s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.906s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-797866665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6095f48-c87f-48b0-8818-27634ca4dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33920edb98c14a4293483590db9dde51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:58Z,use_quota=True,user_id='3f648bad65d9443a84e1b49ddcef1b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Creating volume b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:01 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 1073741824 Apr 21 20:55:01 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4ca4dd31-f5f5-4970-aa4f-d93b99d70d1d tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 23dd7479-e633-4098-a8b5-05affe5a96a1: created successfully Apr 21 20:55:01 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 1073741824" returned: 0 in 0.730s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 Apr 21 20:55:01 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 23dd7479-e633-4098-a8b5-05affe5a96a1: deleting Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 23dd7479-e633-4098-a8b5-05affe5a96a1: deleting {{(pid=82362) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-379a3a70-374c-45c4-bc0b-d187f4b03427" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-379a3a70-374c-45c4-bc0b-d187f4b03427" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-52ee4e26-dd97-4176-94cf-d558dbc13264" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-52ee4e26-dd97-4176-94cf-d558dbc13264" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Deleting offline snapshot 52ee4e26-dd97-4176-94cf-d558dbc13264 of volume 379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] snapshot_file for this snap is: volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd4d0d0-669a-4601-834e-ae81967e48f5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 Apr 21 20:55:02 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6" returned: 0 in 0.692s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:02 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:02 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Attempting download of ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume b6095f48-c87f-48b0-8818-27634ca4dfc6. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dd6cb1-55d9-42ea-be50-7821246e530e]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_i7xdi57n {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_i7xdi57n Apr 21 20:55:02 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264" returned: 0 in 0.754s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379a3a70-374c-45c4-bc0b-d187f4b03427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0185a62b-fdce-45ea-a909-b55718bacc74]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 Apr 21 20:55:03 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_i7xdi57n" returned: 0 in 0.716s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_i7xdi57n {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.846s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:03 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_i7xdi57n Apr 21 20:55:03 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427" returned: 0 in 0.670s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 Apr 21 20:55:03 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:04 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_i7xdi57n" returned: 1 in 0.683s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_i7xdi57n' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d807b-3ecb-4810-9fcd-697e43dbee88]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:04 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD Apr 21 20:55:04 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:04 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264" returned: 0 in 0.511s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:04 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264 Apr 21 20:55:04 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:04 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 was qcow2, converting to raw {{(pid=82362) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:04 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 Apr 21 20:55:04 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:04 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427.52ee4e26-dd97-4176-94cf-d558dbc13264" returned: 0 in 0.582s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-52ee4e26-dd97-4176-94cf-d558dbc13264" released by "_delete_snapshot" :: held 2.583s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-379a3a70-374c-45c4-bc0b-d187f4b03427" released by "delete_snapshot" :: held 2.611s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:04 devstack cinder-volume[82362]: WARNING cinder.quota [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-289918279 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-289918279, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:04 devstack cinder-volume[82362]: WARNING cinder.quota [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-289918279 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-289918279, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:05 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['9f97c3a4-9bae-43eb-957d-99ddbff72adb', '0c2bcb53-2bd8-4dce-8d34-a1a38473ccaf', '969a29d7-c681-4202-b82e-8573f139ab97', '78185619-0d27-48f1-9a66-abc805574846'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:05 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-624f490b-73c4-42b9-94c1-9eef092af9a2 tempest-GroupSnapshotsTest-1468255330 None] group_snapshot 23dd7479-e633-4098-a8b5-05affe5a96a1: deleted successfully Apr 21 20:55:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "cinder-quobyte-379a3a70-374c-45c4-bc0b-d187f4b03427" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-379a3a70-374c-45c4-bc0b-d187f4b03427" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:05 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde31f5-4af5-401b-b2a3-d02734316ba8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6" returned: 0 in 1.384s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_lw1_uhcqdevstack@QuobyteHD, size 112.00 MB, duration 1.39 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:06 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Converted 112.00 MB image at 80.80 MB/s Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 1G Apr 21 20:55:06 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 Apr 21 20:55:06 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427" returned: 0 in 0.714s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427 Apr 21 20:55:06 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 1G" returned: 0 in 0.621s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd23bdc2-91e2-4304-bc8d-2fdd24824b23]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 Apr 21 20:55:06 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Flow 'volume_create_manager' (fae191cc-0c66-44ba-b61f-6d7c6d31b076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad46c260-7b98-4c14-adb0-d94646c9e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad46c260-7b98-4c14-adb0-d94646c9e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-28857603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae8940b-cc4f-49e7-b3a4-bcd61c5425c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5e3c3bccc3421caed68c73e1788cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:07Z,use_quota=True,user_id='66c3c3968b7845a18a1cab6d4ee2fd44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f74309-186e-4dc8-9ddd-373fd43e7c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f74309-186e-4dc8-9ddd-373fd43e7c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a067e07a-6af8-447d-ba54-fa40a4782019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a067e07a-6af8-447d-ba54-fa40a4782019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae8940b-cc4f-49e7-b3a4-bcd61c5425c9', 'volume_name': 'volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6fb247-e20f-4689-8a94-b95b2a4c9a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6fb247-e20f-4689-8a94-b95b2a4c9a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda7f6bb-e3d6-4805-9125-52635d6c1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Volume cae8940b-cc4f-49e7-b3a4-bcd61c5425c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9', 'volume_size': 1} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-28857603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae8940b-cc4f-49e7-b3a4-bcd61c5425c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5e3c3bccc3421caed68c73e1788cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:07Z,use_quota=True,user_id='66c3c3968b7845a18a1cab6d4ee2fd44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Creating volume cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:06 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 1073741824 Apr 21 20:55:06 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:07 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-379a3a70-374c-45c4-bc0b-d187f4b03427" returned: 0 in 0.470s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Lock "cinder-quobyte-379a3a70-374c-45c4-bc0b-d187f4b03427" released by "delete_volume" :: held 1.239s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['2151a741-97ca-499a-85e6-2a834cc5f3ed'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:07 devstack cinder-volume[82362]: WARNING cinder.quota [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-289918279 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-289918279, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Created reservations ['aa8b698a-ac46-4b98-aebf-350c961907e8', 'd72e5ecb-ab03-4ee6-8939-1c1301939d57', 'd1dba67a-63be-45e6-996e-3a3a549ec14c', 'c3a058e0-f100-43a2-9d3d-2346ad3136c2'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:07 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:07 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6" returned: 0 in 0.738s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:07 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 Apr 21 20:55:07 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:07 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 1073741824" returned: 0 in 0.699s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:07 devstack sudo[86645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 Apr 21 20:55:07 devstack sudo[86645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:07 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.509s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:07 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-dfbb8bf6-f485-4730-9790-789c5cdb7038 tempest-GroupSnapshotsTest-1468255330 None] Delete group completed successfully. Apr 21 20:55:08 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6" returned: 1 in 0.593s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Downloaded image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume b6095f48-c87f-48b0-8818-27634ca4dfc6 successfully. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 for user 3f648bad65d9443a84e1b49ddcef1b90 is deleted. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Marking volume b6095f48-c87f-48b0-8818-27634ca4dfc6 as bootable. {{(pid=82362) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Copying metadata from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 to b6095f48-c87f-48b0-8818-27634ca4dfc6. {{(pid=82362) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Creating volume glance metadata for volume b6095f48-c87f-48b0-8818-27634ca4dfc6 backed by image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82362) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c428b0-5ef8-4201-8c33-cded9c0a3859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6095f48-c87f-48b0-8818-27634ca4dfc6', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455b6dc8-5d8a-4c5c-a348-d57710bc54a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:08 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Volume volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 (b6095f48-c87f-48b0-8818-27634ca4dfc6): created successfully Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455b6dc8-5d8a-4c5c-a348-d57710bc54a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Flow 'volume_create_manager' (abbb65e0-0198-40d0-b1d6-c2d4c4e27a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:08 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e54177e8-06bc-4655-9579-071f151664a0 tempest-VolumesImageMetadata-820007037 None] Created volume successfully. Apr 21 20:55:08 devstack sudo[86645]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda7f6bb-e3d6-4805-9125-52635d6c1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10ae75b-c397-4938-ad3e-cc532d56c441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:08 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Volume volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 (cae8940b-cc4f-49e7-b3a4-bcd61c5425c9): created successfully Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e10ae75b-c397-4938-ad3e-cc532d56c441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Flow 'volume_create_manager' (fae191cc-0c66-44ba-b61f-6d7c6d31b076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:08 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-07984ff4-f735-4bef-8ea9-fc0d40176438 tempest-VolumesTransfersTest-1057403208 None] Created volume successfully. Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Acquiring lock "cinder-b6095f48-c87f-48b0-8818-27634ca4dfc6-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Lock "cinder-b6095f48-c87f-48b0-8818-27634ca4dfc6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Acquiring lock "cinder-quobyte-b6095f48-c87f-48b0-8818-27634ca4dfc6" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Lock "cinder-quobyte-b6095f48-c87f-48b0-8818-27634ca4dfc6" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[124e98d5-1601-4555-a235-282814195d2c]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:08 devstack sudo[86652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 Apr 21 20:55:08 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:09 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6" returned: 0 in 0.708s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:09 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 Apr 21 20:55:09 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:09 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d2a784a9-e5f6-4f9b-a4e0-f13da58b05b2 tempest-VolumesTransfersTest-975661663 None] Transfer volume completed successfully. Apr 21 20:55:10 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6" returned: 1 in 0.605s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:10 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6 Apr 21 20:55:10 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:10 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b6095f48-c87f-48b0-8818-27634ca4dfc6" returned: 0 in 0.689s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Lock "cinder-quobyte-b6095f48-c87f-48b0-8818-27634ca4dfc6" released by "delete_volume" :: held 2.050s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Created reservations ['8dcbc8a8-99b1-4fca-b2e2-a2301a503c1a', 'a75fcc93-1a8c-40d6-b99f-94f3ecc3575b', '4853e9c4-d976-43e9-bcba-77780f54485e', '1344803d-f9c1-4ee0-9946-fb65bcc9ac03'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Acquiring lock "cinder-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Lock "cinder-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Acquiring lock "cinder-quobyte-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Lock "cinder-quobyte-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd164cc8-70e2-426c-9205-e9d07662e9c5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:11 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:11 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:11 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 Apr 21 20:55:11 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:11 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.631s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:11 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Deleted volume successfully. Apr 21 20:55:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ad28ee66-63ce-4481-b31d-61862591154b tempest-VolumesImageMetadata-820007037 None] Lock "cinder-b6095f48-c87f-48b0-8818-27634ca4dfc6-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:11 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9" returned: 0 in 0.983s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:12 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9 Apr 21 20:55:12 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:12 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9" returned: 0 in 0.634s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Lock "cinder-quobyte-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9" released by "delete_volume" :: held 1.670s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Created reservations ['0f54bb3f-11a2-43f5-95c4-286ead4954e1', '60555233-5566-44bb-9502-d2120162d9f3', '0790d9b0-3366-48a2-b9e7-2269f0a95f02', '9c565cac-e4d9-496c-8bc2-7d7de5277ddd'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:12 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:12 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:13 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.593s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:13 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Deleted volume successfully. Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-707dc051-020e-4807-9723-4532add2ad16 tempest-VolumesTransfersTest-700494709 None] Lock "cinder-cae8940b-cc4f-49e7-b3a4-bcd61c5425c9-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Flow 'volume_create_manager' (83375d12-2ae9-431f-af22-23233f8197c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7ec5e5-f066-41dc-9242-9a77cf3f6218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7ec5e5-f066-41dc-9242-9a77cf3f6218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1938234657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09aac29-e663-4408-ab24-ccc37aa4b164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5e3c3bccc3421caed68c73e1788cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:13Z,use_quota=True,user_id='66c3c3968b7845a18a1cab6d4ee2fd44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43826a07-f196-4d3b-b88d-e933f17efdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43826a07-f196-4d3b-b88d-e933f17efdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22619842-22cf-4ce0-a25c-1c7507d6f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22619842-22cf-4ce0-a25c-1c7507d6f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09aac29-e663-4408-ab24-ccc37aa4b164', 'volume_name': 'volume-c09aac29-e663-4408-ab24-ccc37aa4b164', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f661f967-f225-4681-bbdc-1d33c82ba3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f661f967-f225-4681-bbdc-1d33c82ba3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db138c13-62a3-4a78-a686-a33c97559f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:13 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Volume c09aac29-e663-4408-ab24-ccc37aa4b164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09aac29-e663-4408-ab24-ccc37aa4b164', 'volume_size': 1} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1938234657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09aac29-e663-4408-ab24-ccc37aa4b164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5e3c3bccc3421caed68c73e1788cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:13Z,use_quota=True,user_id='66c3c3968b7845a18a1cab6d4ee2fd44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Creating volume c09aac29-e663-4408-ab24-ccc37aa4b164 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:13 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:13 devstack sudo[86680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 1073741824 Apr 21 20:55:13 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:14 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 1073741824" returned: 0 in 0.705s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:14 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 Apr 21 20:55:14 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:14 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164" returned: 0 in 0.610s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:14 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db138c13-62a3-4a78-a686-a33c97559f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09aac29-e663-4408-ab24-ccc37aa4b164', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:14 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5982c05-3dc9-4dd9-b240-8f29d888acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:15 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Volume volume-c09aac29-e663-4408-ab24-ccc37aa4b164 (c09aac29-e663-4408-ab24-ccc37aa4b164): created successfully Apr 21 20:55:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5982c05-3dc9-4dd9-b240-8f29d888acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Flow 'volume_create_manager' (83375d12-2ae9-431f-af22-23233f8197c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7d50cf63-e03f-4842-9077-a5478b625ef8 tempest-VolumesTransfersTest-1057403208 None] Created volume successfully. Apr 21 20:55:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Acquiring lock "cinder-c09aac29-e663-4408-ab24-ccc37aa4b164-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Lock "cinder-c09aac29-e663-4408-ab24-ccc37aa4b164-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Acquiring lock "cinder-quobyte-c09aac29-e663-4408-ab24-ccc37aa4b164" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Lock "cinder-quobyte-c09aac29-e663-4408-ab24-ccc37aa4b164" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:16 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9439fb90-a8b7-4814-89a8-715c57b37597]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:16 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 Apr 21 20:55:16 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:16 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164" returned: 0 in 0.678s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:16 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164 Apr 21 20:55:16 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:17 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c09aac29-e663-4408-ab24-ccc37aa4b164" returned: 0 in 0.467s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Lock "cinder-quobyte-c09aac29-e663-4408-ab24-ccc37aa4b164" released by "delete_volume" :: held 1.175s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Created reservations ['613a5c59-9cee-4746-bfb5-765d110e798f', '9874668e-8d47-4c63-9318-66d880c2b1f3', 'b5c11bfd-a649-4262-87b6-eccbdcbe5f78', 'ad5cd8b0-cc85-4682-8216-e86c1191a4f4'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:17 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:17 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-afedba54-d2c3-4289-830c-169c491b71cb tempest-GroupsV320Test-41743964 None] Group tempest-GroupsV320Test-Group-1345077431: creating Apr 21 20:55:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-afedba54-d2c3-4289-830c-169c491b71cb tempest-GroupsV320Test-41743964 None] Group tempest-GroupsV320Test-Group-1345077431: created successfully Apr 21 20:55:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-afedba54-d2c3-4289-830c-169c491b71cb tempest-GroupsV320Test-41743964 None] Create group completed successfully. Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Flow 'volume_create_manager' (0698afe6-1cf2-4cea-9e25-024d31b480f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e489dc-4d25-4d91-a058-2ce7f1693a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:17 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e489dc-4d25-4d91-a058-2ce7f1693a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-418276494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252f3216-1c3c-4201-b439-fac1afa8124e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2053c75e39d14a63a19bc5c7cdc572c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:18Z,use_quota=True,user_id='1c5296e6a4ec42149d9e76f2fd62835a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11465109-2001-4a78-81d2-17774642617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11465109-2001-4a78-81d2-17774642617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1b52d0-62e4-401c-a5e1-ffe2363474fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1b52d0-62e4-401c-a5e1-ffe2363474fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252f3216-1c3c-4201-b439-fac1afa8124e', 'volume_name': 'volume-252f3216-1c3c-4201-b439-fac1afa8124e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29063bb6-763e-432f-bc14-2d90cbdf1d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29063bb6-763e-432f-bc14-2d90cbdf1d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64494720-6ee6-43d2-9952-23672ad89fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:17 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Volume 252f3216-1c3c-4201-b439-fac1afa8124e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252f3216-1c3c-4201-b439-fac1afa8124e', 'volume_size': 1} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-418276494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252f3216-1c3c-4201-b439-fac1afa8124e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2053c75e39d14a63a19bc5c7cdc572c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:18Z,use_quota=True,user_id='1c5296e6a4ec42149d9e76f2fd62835a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Creating volume 252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:17 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.622s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Deleted volume successfully. Apr 21 20:55:17 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e 1073741824 Apr 21 20:55:17 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ff24a8d4-3a7d-4d48-b6e7-d1051c7a07cd tempest-VolumesTransfersTest-700494709 None] Lock "cinder-c09aac29-e663-4408-ab24-ccc37aa4b164-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:18 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e 1073741824" returned: 0 in 0.572s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:18 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e Apr 21 20:55:18 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Created reservations ['200aed3c-9489-4792-a2f7-eb49ab851322'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:19 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e" returned: 0 in 0.550s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64494720-6ee6-43d2-9952-23672ad89fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252f3216-1c3c-4201-b439-fac1afa8124e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774263fe-1ea0-491c-80de-bfd0685c215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Volume volume-252f3216-1c3c-4201-b439-fac1afa8124e (252f3216-1c3c-4201-b439-fac1afa8124e): created successfully Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774263fe-1ea0-491c-80de-bfd0685c215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Flow 'volume_create_manager' (0698afe6-1cf2-4cea-9e25-024d31b480f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-defaa603-2a9c-482f-886d-096ed37506a4 tempest-VolumesDeleteCascade-1750597874 None] Created volume successfully. Apr 21 20:55:19 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.461s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:19 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c8582ee1-9030-45f5-acab-085977cf45a6 tempest-GroupsV320Test-41743964 None] Delete group completed successfully. Apr 21 20:55:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Creating offline snapshot 498f2503-0b1f-4b71-971a-c1a7c20ab1ce of volume 252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:20 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a014b-9d26-4027-91cf-3f12f88cb0cb]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:20 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e Apr 21 20:55:20 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:21 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e" returned: 0 in 0.818s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce 1G Apr 21 20:55:21 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:21 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce 1G" returned: 0 in 0.852s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce Apr 21 20:55:21 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:22 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce" returned: 0 in 0.771s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce is being set with open permissions: ugo+rw Apr 21 20:55:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:22 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce Apr 21 20:55:22 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:23 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce" returned: 0 in 0.610s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:23 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.info Apr 21 20:55:23 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:23 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.info" returned: 0 in 0.589s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:23 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.info is being set with open permissions: ugo+rw Apr 21 20:55:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:23 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.info Apr 21 20:55:23 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Flow 'volume_create_manager' (a14b2b67-9369-4907-b9fb-1fe4de9942bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c764eb73-1507-4b4e-bdf0-9b3733b2ccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:24 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.info" returned: 0 in 0.709s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.435s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c764eb73-1507-4b4e-bdf0-9b3733b2ccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-297965824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d0e3b3-ae05-4578-a8e8-05009cef79a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccdb46535541c3a3b78f924056961c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:24Z,use_quota=True,user_id='d60d186882c8422581b1273e1c3a2689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c9b813-a336-4f3a-bd18-0ec609131d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c9b813-a336-4f3a-bd18-0ec609131d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d99d2da-12c8-47fe-b3c6-7f82afd2f35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d99d2da-12c8-47fe-b3c6-7f82afd2f35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d0e3b3-ae05-4578-a8e8-05009cef79a9', 'volume_name': 'volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a48772-d957-4725-a0fd-bfc0d00a8032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a48772-d957-4725-a0fd-bfc0d00a8032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f20ec9-7fb9-4e50-b902-a326b5af33cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:24 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Volume 39d0e3b3-ae05-4578-a8e8-05009cef79a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9', 'volume_size': 1} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-297965824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d0e3b3-ae05-4578-a8e8-05009cef79a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccdb46535541c3a3b78f924056961c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:24Z,use_quota=True,user_id='d60d186882c8422581b1273e1c3a2689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Creating volume 39d0e3b3-ae05-4578-a8e8-05009cef79a9 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:24 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:24 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 1073741824 Apr 21 20:55:24 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:24 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7de8a2f2-a76a-4ec5-97b1-79cbae2cf2b7 tempest-VolumesDeleteCascade-1750597874 None] Create snapshot completed successfully Apr 21 20:55:25 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 1073741824" returned: 0 in 0.649s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:25 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 Apr 21 20:55:25 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:25 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9" returned: 0 in 0.634s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f20ec9-7fb9-4e50-b902-a326b5af33cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b3012b-87e2-49e1-9290-92f3a47336c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Creating offline snapshot bd3373e6-3437-4450-9fed-96d9e20f02a9 of volume 252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:26 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Volume volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 (39d0e3b3-ae05-4578-a8e8-05009cef79a9): created successfully Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b3012b-87e2-49e1-9290-92f3a47336c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Flow 'volume_create_manager' (a14b2b67-9369-4907-b9fb-1fe4de9942bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ca9b7-b75e-4eef-9bf9-9166872fc89e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d006f914-a31b-492b-be51-84dbb1f830b2 tempest-VolumesTransfersV357Test-1278718472 None] Created volume successfully. Apr 21 20:55:26 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce Apr 21 20:55:26 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:26 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce" returned: 0 in 0.554s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252f3216-1c3c-4201-b439-fac1afa8124e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 1G Apr 21 20:55:26 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 1G" returned: 0 in 0.704s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 Apr 21 20:55:27 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c0fb0f99-5784-4ced-928d-cae047670363 tempest-VolumesTransfersV357Test-948655021 None] Transfer volume completed successfully. Apr 21 20:55:28 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9" returned: 0 in 0.796s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 is being set with open permissions: ugo+rw Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 Apr 21 20:55:28 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Acquiring lock "cinder-39d0e3b3-ae05-4578-a8e8-05009cef79a9-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-39d0e3b3-ae05-4578-a8e8-05009cef79a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Acquiring lock "cinder-quobyte-39d0e3b3-ae05-4578-a8e8-05009cef79a9" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-quobyte-39d0e3b3-ae05-4578-a8e8-05009cef79a9" acquired by "delete_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd3b6bb-1a66-4a9a-9eac-5416fdd3fb97]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9" returned: 0 in 0.673s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.844s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d20f026a-6c40-4ebd-8036-c5af7302fad7 tempest-VolumesDeleteCascade-1750597874 None] Create snapshot completed successfully Apr 21 20:55:28 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 Apr 21 20:55:28 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:29 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9" returned: 0 in 0.680s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:29 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9 Apr 21 20:55:29 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-252f3216-1c3c-4201-b439-fac1afa8124e-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-252f3216-1c3c-4201-b439-fac1afa8124e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Performing cascade delete. {{(pid=82362) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-498f2503-0b1f-4b71-971a-c1a7c20ab1ce-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-498f2503-0b1f-4b71-971a-c1a7c20ab1ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:30 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39d0e3b3-ae05-4578-a8e8-05009cef79a9" returned: 0 in 0.655s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-quobyte-39d0e3b3-ae05-4578-a8e8-05009cef79a9" released by "delete_volume" :: held 1.402s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-498f2503-0b1f-4b71-971a-c1a7c20ab1ce" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-498f2503-0b1f-4b71-971a-c1a7c20ab1ce" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Deleting offline snapshot 498f2503-0b1f-4b71-971a-c1a7c20ab1ce of volume 252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] snapshot_file for this snap is: volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[83600ec4-0c8b-420f-8947-f6f6d3ac88e5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Created reservations ['0f94e23d-d79e-404a-aac9-3039d66a1eb7', '690ab10f-8b72-4197-a987-e98d76ea9d12', '73e13327-83a5-4b16-aac2-69abc27ec2ca', 'a0d00e83-dd42-4238-9738-3650931080d1'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:30 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce Apr 21 20:55:30 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[87090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:30 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce" returned: 0 in 0.635s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252f3216-1c3c-4201-b439-fac1afa8124e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d66f56-2fb9-4cef-bdc2-631efeb23fc5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e Apr 21 20:55:30 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.807s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:31 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Deleted volume successfully. Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e11b953b-d65f-4793-a0d1-492b0671c258 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-39d0e3b3-ae05-4578-a8e8-05009cef79a9-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Flow 'volume_create_manager' (a78e6f8c-692d-4400-bd16-8dfc94b24bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bceeb04-e8d0-4a3e-9347-f0a7f701d537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bceeb04-e8d0-4a3e-9347-f0a7f701d537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2116843058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3625391-d100-4676-b05e-6d3d0db0a820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccdb46535541c3a3b78f924056961c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:31Z,use_quota=True,user_id='d60d186882c8422581b1273e1c3a2689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d956f2-434a-4188-a3f6-8692f48f1527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d956f2-434a-4188-a3f6-8692f48f1527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1614e12f-c13a-4676-a548-0716c67ebc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1614e12f-c13a-4676-a548-0716c67ebc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3625391-d100-4676-b05e-6d3d0db0a820', 'volume_name': 'volume-b3625391-d100-4676-b05e-6d3d0db0a820', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84453bf-4705-4635-a550-6ed938b28fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84453bf-4705-4635-a550-6ed938b28fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70614e8d-789e-40db-80a3-5d891de1e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:31 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Volume b3625391-d100-4676-b05e-6d3d0db0a820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3625391-d100-4676-b05e-6d3d0db0a820', 'volume_size': 1} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2116843058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3625391-d100-4676-b05e-6d3d0db0a820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccdb46535541c3a3b78f924056961c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:31Z,use_quota=True,user_id='d60d186882c8422581b1273e1c3a2689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Creating volume b3625391-d100-4676-b05e-6d3d0db0a820 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:31 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 1073741824 Apr 21 20:55:31 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e" returned: 0 in 0.780s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[982aa159-24fe-410f-bd67-da8a35580d09]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 Apr 21 20:55:31 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 1073741824" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:32 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 Apr 21 20:55:32 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:32 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9" returned: 0 in 0.687s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252f3216-1c3c-4201-b439-fac1afa8124e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6c1918-453a-4f24-84c6-3fff56f8aeb1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:32 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce Apr 21 20:55:32 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:32 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820" returned: 0 in 0.686s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70614e8d-789e-40db-80a3-5d891de1e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3625391-d100-4676-b05e-6d3d0db0a820', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336b9c5d-2bf9-4ead-8027-200924d37f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Volume volume-b3625391-d100-4676-b05e-6d3d0db0a820 (b3625391-d100-4676-b05e-6d3d0db0a820): created successfully Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336b9c5d-2bf9-4ead-8027-200924d37f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Flow 'volume_create_manager' (a78e6f8c-692d-4400-bd16-8dfc94b24bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:32 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3d016fdc-1329-46ca-9336-0248a7413343 tempest-VolumesTransfersV357Test-1278718472 None] Created volume successfully. Apr 21 20:55:33 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce" returned: 0 in 0.777s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252f3216-1c3c-4201-b439-fac1afa8124e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56e4ba4-ada7-4a7c-af4e-235b7a4deef8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:33 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e Apr 21 20:55:33 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Acquiring lock "cinder-b3625391-d100-4676-b05e-6d3d0db0a820-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:33 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-b3625391-d100-4676-b05e-6d3d0db0a820-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e" returned: 0 in 0.781s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Acquiring lock "cinder-quobyte-b3625391-d100-4676-b05e-6d3d0db0a820" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:34 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce Apr 21 20:55:34 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-quobyte-b3625391-d100-4676-b05e-6d3d0db0a820" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f933283b-28cb-45a5-b218-80097433f846]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:34 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 Apr 21 20:55:34 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:34 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce" returned: 0 in 0.814s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:34 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce Apr 21 20:55:34 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:34 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820" returned: 0 in 0.807s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:34 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820 Apr 21 20:55:34 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:35 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.498f2503-0b1f-4b71-971a-c1a7c20ab1ce" returned: 0 in 0.672s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 -F qcow2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:35 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 -F qcow2 Apr 21 20:55:35 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:35 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b3625391-d100-4676-b05e-6d3d0db0a820" returned: 0 in 0.771s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-quobyte-b3625391-d100-4676-b05e-6d3d0db0a820" released by "delete_volume" :: held 1.612s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Created reservations ['20fb5af2-e590-458b-9a56-1247bb96c572', '10f8fbf7-ff14-447f-83b1-8fc7ea3c07c2', 'd003319b-b7af-4510-9ff0-48bba2f527ad', 'bd5e169e-4f7b-4aac-a370-c5fd40c155f1'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:35 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:35 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:36 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252f3216-1c3c-4201-b439-fac1afa8124e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 -F qcow2" returned: 0 in 0.881s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-498f2503-0b1f-4b71-971a-c1a7c20ab1ce" released by "_delete_snapshot" :: held 6.196s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" released by "delete_snapshot" :: held 6.229s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Created reservations ['a62942fd-0636-4f73-944e-b17c8865d8e7', '1b2b478c-3174-431f-b19e-66a726f89ed1', '1e086a4b-34c4-495e-b5f0-6ee2e5ce5679', '08a8c0af-ba48-4d4c-9d84-e7680f19ccc0'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:36 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Delete snapshot completed successfully. Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-498f2503-0b1f-4b71-971a-c1a7c20ab1ce-delete_snapshot" released by "delete_snapshot" :: held 6.518s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-bd3373e6-3437-4450-9fed-96d9e20f02a9-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-bd3373e6-3437-4450-9fed-96d9e20f02a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-bd3373e6-3437-4450-9fed-96d9e20f02a9" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-bd3373e6-3437-4450-9fed-96d9e20f02a9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Deleting offline snapshot bd3373e6-3437-4450-9fed-96d9e20f02a9 of volume 252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] snapshot_file for this snap is: volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0291fef-85e8-45ff-b6b7-9b22b6c9e22c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:36 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 Apr 21 20:55:36 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:37 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 1.254s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:37 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Deleted volume successfully. Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7b019be9-f733-42c3-8892-e5134009c486 tempest-VolumesTransfersV357Test-879059723 None] Lock "cinder-b3625391-d100-4676-b05e-6d3d0db0a820-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Flow 'volume_create_manager' (88ea53ce-ee9e-4f61-a2e7-0eeff574d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1066668-10c0-47b4-9afa-21f7ddadac28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1066668-10c0-47b4-9afa-21f7ddadac28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1653982076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924131b5-d772-4895-a961-15251c1f5573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df194f6eedc4100a4f9c6854edeb11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:37Z,use_quota=True,user_id='987d9c3986e84af5920d78de79f301bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4120774-f54a-4dca-aa2f-e549f47b4471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4120774-f54a-4dca-aa2f-e549f47b4471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1433e552-c13f-44aa-976f-0f1a4ad4e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1433e552-c13f-44aa-976f-0f1a4ad4e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924131b5-d772-4895-a961-15251c1f5573', 'volume_name': 'volume-924131b5-d772-4895-a961-15251c1f5573', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eb49af-8be7-4388-89ba-3aaf0cddf9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eb49af-8be7-4388-89ba-3aaf0cddf9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4474073-4fb0-48af-8bd5-3e71f01e2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:37 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Volume 924131b5-d772-4895-a961-15251c1f5573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924131b5-d772-4895-a961-15251c1f5573', 'volume_size': 1} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1653982076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924131b5-d772-4895-a961-15251c1f5573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df194f6eedc4100a4f9c6854edeb11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:37Z,use_quota=True,user_id='987d9c3986e84af5920d78de79f301bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Creating volume 924131b5-d772-4895-a961-15251c1f5573 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:37 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:37 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 1073741824 Apr 21 20:55:37 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:37 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9" returned: 0 in 1.066s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252f3216-1c3c-4201-b439-fac1afa8124e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e09e1b-9595-413d-8450-76258c09579c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:37 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e Apr 21 20:55:37 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:38 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 1073741824" returned: 0 in 1.329s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:38 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 Apr 21 20:55:38 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e" returned: 0 in 1.278s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 Apr 21 20:55:39 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573" returned: 0 in 0.612s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4474073-4fb0-48af-8bd5-3e71f01e2b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924131b5-d772-4895-a961-15251c1f5573', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e07f83-fd88-4439-b888-b1d7b98bc13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:39 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Volume volume-924131b5-d772-4895-a961-15251c1f5573 (924131b5-d772-4895-a961-15251c1f5573): created successfully Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e07f83-fd88-4439-b888-b1d7b98bc13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Flow 'volume_create_manager' (88ea53ce-ee9e-4f61-a2e7-0eeff574d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-6c7940c3-aa7a-4b73-89f6-baecbf63f3de tempest-VolumeQuotasNegativeTestJSON-577134736 None] Created volume successfully. Apr 21 20:55:39 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9" returned: 0 in 0.698s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9 Apr 21 20:55:39 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e.bd3373e6-3437-4450-9fed-96d9e20f02a9" returned: 0 in 0.805s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-bd3373e6-3437-4450-9fed-96d9e20f02a9" released by "_delete_snapshot" :: held 3.934s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" released by "delete_snapshot" :: held 3.958s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Created reservations ['c11b7e0b-ff8e-4a22-be10-fe1693695c3e', 'd6721430-958a-45ac-852b-05e6644c9a19', 'aa7bcff9-6eda-4540-aa53-148ab8cb4277', '3d4a57a8-1523-4943-9a7d-2ec55136235f'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:40 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Delete snapshot completed successfully. Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-bd3373e6-3437-4450-9fed-96d9e20f02a9-delete_snapshot" released by "delete_snapshot" :: held 4.156s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Snapshots deleted, issuing volume delete {{(pid=82362) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" acquired by "delete_volume" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf0a1c-ab4f-4842-a864-97998339bdb2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Acquiring lock "cinder-924131b5-d772-4895-a961-15251c1f5573-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "cinder-924131b5-d772-4895-a961-15251c1f5573-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Acquiring lock "cinder-quobyte-924131b5-d772-4895-a961-15251c1f5573" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "cinder-quobyte-924131b5-d772-4895-a961-15251c1f5573" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ec7d44-b055-4ad8-9314-a26b70b32729]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e Apr 21 20:55:40 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:41 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 Apr 21 20:55:41 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:41 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573" returned: 0 in 0.802s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:41 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e" returned: 0 in 0.985s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:41 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573 Apr 21 20:55:41 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:41 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e Apr 21 20:55:41 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:42 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-924131b5-d772-4895-a961-15251c1f5573" returned: 0 in 0.702s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "cinder-quobyte-924131b5-d772-4895-a961-15251c1f5573" released by "delete_volume" :: held 1.531s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Created reservations ['1f08cf9c-44c9-413f-8303-d8a2bbdb12dc', '23fd9186-ce93-483f-ac92-495b28701f27', 'bd12d1f1-55dd-4552-b19d-8e5123c13aeb', '5de12618-7b4f-42f9-bdb7-5925b1e040c8'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:42 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:42 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Flow 'volume_create_manager' (268eb39b-5e13-43c8-b445-7ae23d7b16a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d320f747-ba80-44c8-ae1d-486337d8a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:42 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d320f747-ba80-44c8-ae1d-486337d8a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1598738888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990bf5b3-dacc-4fff-b2f4-d81880301c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162da2b566d44a05931735ed32198022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:43Z,use_quota=True,user_id='9f1e6f3fcd1c47ce85390df100a019f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf69b37-bb20-477b-87f5-f77ceff90cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf69b37-bb20-477b-87f5-f77ceff90cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff57c71b-9541-47d5-9d44-133ba46f4f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff57c71b-9541-47d5-9d44-133ba46f4f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990bf5b3-dacc-4fff-b2f4-d81880301c3e', 'volume_name': 'volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec030c8-7a4e-420d-832f-aad9d14e0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec030c8-7a4e-420d-832f-aad9d14e0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6fb643-1bd3-4415-94b2-9193d9b43d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:42 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Volume 990bf5b3-dacc-4fff-b2f4-d81880301c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e', 'volume_size': 1} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1598738888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990bf5b3-dacc-4fff-b2f4-d81880301c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162da2b566d44a05931735ed32198022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:43Z,use_quota=True,user_id='9f1e6f3fcd1c47ce85390df100a019f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Creating volume 990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:42 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-252f3216-1c3c-4201-b439-fac1afa8124e" returned: 0 in 0.977s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-252f3216-1c3c-4201-b439-fac1afa8124e" released by "delete_volume" :: held 2.018s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:42 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e 1073741824 Apr 21 20:55:42 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Created reservations ['45efafe0-68cf-4bde-98ab-e8e8496ff49f', '35f8d190-c2c4-450e-9e44-a689540f1060', '0f4cb038-c9a6-4bdc-8d89-cfac0477e21c', '99eb955f-a6c7-4a4d-b2d7-aed3b5e226fb'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:42 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:42 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:43 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.780s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:43 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Deleted volume successfully. Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-654110b5-459c-4acd-9162-ed90d5b4daf8 tempest-VolumeQuotasNegativeTestJSON-577134736 None] Lock "cinder-924131b5-d772-4895-a961-15251c1f5573-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:43 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e 1073741824" returned: 0 in 0.891s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:43 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e Apr 21 20:55:43 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:43 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.949s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:43 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Deleted volume successfully. Apr 21 20:55:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5611774c-2b5f-4534-b257-3d0561847e27 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-252f3216-1c3c-4201-b439-fac1afa8124e-delete_volume" released by "delete_volume" :: held 13.980s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Flow 'volume_create_manager' (9a8dc869-a077-4535-ad29-b6f27ea586dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812f96b7-3bef-4ec8-8ae0-5ee675b5674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812f96b7-3bef-4ec8-8ae0-5ee675b5674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-211226532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f373512d-8677-4e74-a186-fec2e4dbde35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2053c75e39d14a63a19bc5c7cdc572c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:44Z,use_quota=True,user_id='1c5296e6a4ec42149d9e76f2fd62835a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a540e-7478-4fcd-ac60-e95550b0087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee4a540e-7478-4fcd-ac60-e95550b0087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83de59c4-2fdc-40ab-89d8-ca2b744721ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83de59c4-2fdc-40ab-89d8-ca2b744721ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f373512d-8677-4e74-a186-fec2e4dbde35', 'volume_name': 'volume-f373512d-8677-4e74-a186-fec2e4dbde35', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f09987-f4f7-46de-8f4b-098d9143b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f09987-f4f7-46de-8f4b-098d9143b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9fc3fb-498d-4309-98ea-9054124b940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Volume f373512d-8677-4e74-a186-fec2e4dbde35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f373512d-8677-4e74-a186-fec2e4dbde35', 'volume_size': 1} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:44 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e" returned: 0 in 1.209s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.214s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-211226532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f373512d-8677-4e74-a186-fec2e4dbde35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2053c75e39d14a63a19bc5c7cdc572c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:44Z,use_quota=True,user_id='1c5296e6a4ec42149d9e76f2fd62835a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Creating volume f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:44 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6fb643-1bd3-4415-94b2-9193d9b43d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 1073741824 Apr 21 20:55:44 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c545350-3fbc-44a3-a286-aecc9c11614e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Volume volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e (990bf5b3-dacc-4fff-b2f4-d81880301c3e): created successfully Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c545350-3fbc-44a3-a286-aecc9c11614e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Flow 'volume_create_manager' (268eb39b-5e13-43c8-b445-7ae23d7b16a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c9d20f50-694e-40d1-9bce-872e937b94c7 tempest-VolumesCloneTest-1725260943 None] Created volume successfully. Apr 21 20:55:45 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 1073741824" returned: 0 in 0.936s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:45 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 Apr 21 20:55:45 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:46 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35" returned: 0 in 0.868s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9fc3fb-498d-4309-98ea-9054124b940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f373512d-8677-4e74-a186-fec2e4dbde35', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebc1681-4fc0-4a63-bfa0-1a4e5b41f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Volume volume-f373512d-8677-4e74-a186-fec2e4dbde35 (f373512d-8677-4e74-a186-fec2e4dbde35): created successfully Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebc1681-4fc0-4a63-bfa0-1a4e5b41f299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Flow 'volume_create_manager' (9a8dc869-a077-4535-ad29-b6f27ea586dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:46 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2c443813-d2af-457d-8ae7-a85f90672862 tempest-VolumesDeleteCascade-1750597874 None] Created volume successfully. Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Flow 'volume_create_manager' (4f5b129f-6355-4102-b1aa-8a370e5ce4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28629241-0e0a-4da7-ae54-5e4c15827cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28629241-0e0a-4da7-ae54-5e4c15827cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1680337372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02bf5e96-aff8-4816-89bf-8e73ce454fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162da2b566d44a05931735ed32198022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=990bf5b3-dacc-4fff-b2f4-d81880301c3e,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:47Z,use_quota=True,user_id='9f1e6f3fcd1c47ce85390df100a019f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54503574-38ca-4e0a-82c2-2ac2e67f4694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54503574-38ca-4e0a-82c2-2ac2e67f4694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8184bf61-dace-4a9c-a295-9add425e8e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8184bf61-dace-4a9c-a295-9add425e8e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '02bf5e96-aff8-4816-89bf-8e73ce454fdc', 'volume_name': 'volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc', 'volume_size': 2, 'source_volid': '990bf5b3-dacc-4fff-b2f4-d81880301c3e', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c077f907-aa2e-4f71-9069-9e4f4145b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c077f907-aa2e-4f71-9069-9e4f4145b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf64590-6024-4a03-b4ec-e82f450e703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Volume 02bf5e96-aff8-4816-89bf-8e73ce454fdc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc', 'volume_size': 2, 'source_volid': '990bf5b3-dacc-4fff-b2f4-d81880301c3e', 'source_volstatus': 'available'} Apr 21 20:55:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:47 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Cloning volume 990bf5b3-dacc-4fff-b2f4-d81880301c3e to volume 02bf5e96-aff8-4816-89bf-8e73ce454fdc Apr 21 20:55:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Creating offline snapshot 793cdc6a-99d0-4aff-9db5-a8438ecdfec7 of volume 990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:47 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a62e4e-6289-4d0c-aacf-9b4ff2fe9dfd]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:47 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e Apr 21 20:55:47 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:48 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e" returned: 0 in 1.006s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:48 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 1G Apr 21 20:55:48 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:48 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 1G" returned: 0 in 0.719s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:48 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 Apr 21 20:55:48 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Flow 'volume_create_manager' (4e5e95ae-2fb6-431b-866e-4398f4658db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3bb40e-5178-4067-8eca-995d1f3c0413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3bb40e-5178-4067-8eca-995d1f3c0413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-255809192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce906af-4b45-42f8-a4f1-0968f84d18bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9761c82aea40148d1387b8edd34ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:49Z,use_quota=True,user_id='1c337d7b1ae748888d58dc02fe3f2d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060907c6-6b73-44b0-9fb5-689852849255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060907c6-6b73-44b0-9fb5-689852849255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283b4fd0-c9bf-4de0-8a94-274a4f8227b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283b4fd0-c9bf-4de0-8a94-274a4f8227b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce906af-4b45-42f8-a4f1-0968f84d18bb', 'volume_name': 'volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8cbfa2-b038-4222-a6c0-ec9403cdf727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8cbfa2-b038-4222-a6c0-ec9403cdf727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5791809-2169-420d-a7a8-2e5cccdf05fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Volume 7ce906af-4b45-42f8-a4f1-0968f84d18bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb', 'volume_size': 1} Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:49 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7" returned: 0 in 0.660s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:49 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 is being set with open permissions: ugo+rw Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:49 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 Apr 21 20:55:49 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:49 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7" returned: 0 in 0.496s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:50 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.info Apr 21 20:55:50 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:50 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.info" returned: 0 in 0.519s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:50 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.info is being set with open permissions: ugo+rw Apr 21 20:55:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:50 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.info Apr 21 20:55:50 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:50 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.info" returned: 0 in 0.462s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "cinder-quobyte-02bf5e96-aff8-4816-89bf-8e73ce454fdc" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-02bf5e96-aff8-4816-89bf-8e73ce454fdc" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] snapshot: 793cdc6a-99d0-4aff-9db5-a8438ecdfec7, volume: 02bf5e96-aff8-4816-89bf-8e73ce454fdc, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a308a5e4-c24a-472e-8fb3-a83c08e3746b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:51 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 Apr 21 20:55:51 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:51 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e961ee4-890d-432c-aead-93e9d5c92278]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:51 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e Apr 21 20:55:51 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:52 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e" returned: 0 in 0.506s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:52 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:55:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:52 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc Apr 21 20:55:52 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=142,cinder:UPDATE=194,cinder:INSERT=39,cinder:DELETE=12 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:DELETE=13,cinder:SELECT=165,cinder:INSERT=62,cinder:UPDATE=175 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Flow 'volume_create_manager' (b39d654c-c89d-4898-bac8-ecd8cba289d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d3704d-bf9c-4d0b-9e79-124f29fa13a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d3704d-bf9c-4d0b-9e79-124f29fa13a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-785517531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bbb81-7e79-452b-979c-2b542d676ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c544e29b2cfd4bee9b0685108d375576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:55Z,use_quota=True,user_id='6f48597ca7024edc90e4656b0f5f8b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf13e05-9ca1-401d-8d69-89d579fc25a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf13e05-9ca1-401d-8d69-89d579fc25a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a7bb0a-ff72-4142-bf88-612b37819c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a7bb0a-ff72-4142-bf88-612b37819c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6bbb81-7e79-452b-979c-2b542d676ddc', 'volume_name': 'volume-0a6bbb81-7e79-452b-979c-2b542d676ddc', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e62269c-bec1-406e-8a5c-6fe5bcaa410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e62269c-bec1-406e-8a5c-6fe5bcaa410c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dc556f-617b-41ec-b8e5-09b49f36fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Volume 0a6bbb81-7e79-452b-979c-2b542d676ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6bbb81-7e79-452b-979c-2b542d676ddc', 'volume_size': 1} Apr 21 20:55:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:55 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc" returned: 0 in 2.973s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:55 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6065d7-b039-4422-b9b6-2753181d7dfc]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:55 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e Apr 21 20:55:55 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:55 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e" returned: 0 in 0.692s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:55 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:55 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Converted 1024.00 MB image at 344.24 MB/s Apr 21 20:55:55 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc is being set with open permissions: ugo+rw Apr 21 20:55:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:55 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc Apr 21 20:55:55 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-02bf5e96-aff8-4816-89bf-8e73ce454fdc" released by "_copy_volume_from_snapshot" :: held 5.162s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "cinder-quobyte-793cdc6a-99d0-4aff-9db5-a8438ecdfec7" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-793cdc6a-99d0-4aff-9db5-a8438ecdfec7" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Deleting offline snapshot 793cdc6a-99d0-4aff-9db5-a8438ecdfec7 of volume 990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] snapshot_file for this snap is: volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d80ae71-563d-4c9b-9c70-fff85f8aac24]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:56 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 Apr 21 20:55:56 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7" returned: 0 in 0.508s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[73834b85-5718-4e98-9968-a44d128c5846]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:56 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e Apr 21 20:55:56 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:57 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e" returned: 0 in 0.504s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:57 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 Apr 21 20:55:57 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:57 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7" returned: 0 in 0.476s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:57 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7 Apr 21 20:55:57 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:58 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e.793cdc6a-99d0-4aff-9db5-a8438ecdfec7" returned: 0 in 0.424s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-793cdc6a-99d0-4aff-9db5-a8438ecdfec7" released by "_delete_snapshot" :: held 1.981s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.186s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.286s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf64590-6024-4a03-b4ec-e82f450e703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc', 'volume_size': 2, 'source_volid': '990bf5b3-dacc-4fff-b2f4-d81880301c3e', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af301098-65e7-49c7-b6d1-9623f8b762f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Creating offline snapshot 9d573121-8af2-4702-b9fd-eb96cff6af66 of volume f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6403fbdc-fc99-4ba3-81e7-358b2f1e6912]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:58 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Volume volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc (02bf5e96-aff8-4816-89bf-8e73ce454fdc): created successfully Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af301098-65e7-49c7-b6d1-9623f8b762f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Flow 'volume_create_manager' (4f5b129f-6355-4102-b1aa-8a370e5ce4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:58 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e7f58ded-14e7-49c8-a107-befa8d3e65c8 tempest-VolumesCloneTest-1725260943 None] Created volume successfully. Apr 21 20:55:58 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 Apr 21 20:55:58 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "cinder-02bf5e96-aff8-4816-89bf-8e73ce454fdc-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-02bf5e96-aff8-4816-89bf-8e73ce454fdc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "cinder-quobyte-02bf5e96-aff8-4816-89bf-8e73ce454fdc" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-02bf5e96-aff8-4816-89bf-8e73ce454fdc" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c92fc-d9ac-42a3-97ca-0c41a9ce59f0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:58 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc Apr 21 20:55:58 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:58 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35" returned: 0 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:58 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 1G Apr 21 20:55:58 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:59 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc" returned: 0 in 0.572s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:59 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc Apr 21 20:55:59 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:59 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 1G" returned: 0 in 0.523s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f373512d-8677-4e74-a186-fec2e4dbde35 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:59 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f373512d-8677-4e74-a186-fec2e4dbde35 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 Apr 21 20:55:59 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:59 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-02bf5e96-aff8-4816-89bf-8e73ce454fdc" returned: 0 in 0.438s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-02bf5e96-aff8-4816-89bf-8e73ce454fdc" released by "delete_volume" :: held 1.046s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Created reservations ['05da46bc-c1e3-4277-a1af-65671f3ddc23', '1e6a34f0-a996-4c43-a48c-b9467c49a96a', 'fb25ec12-155f-4d17-9f13-9ee5fd800b95', '787fb86b-f275-4ec9-8852-001097fc0762'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:59 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f373512d-8677-4e74-a186-fec2e4dbde35 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66" returned: 0 in 0.480s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:59 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 is being set with open permissions: ugo+rw Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:59 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 Apr 21 20:55:59 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:59 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:55:59 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:00 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.410s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:00 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Deleted volume successfully. Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-758815da-b67f-4f39-8587-26c665f452b7 tempest-VolumesCloneTest-1725260943 None] Lock "cinder-02bf5e96-aff8-4816-89bf-8e73ce454fdc-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:00 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66" returned: 0 in 0.490s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:00 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.info Apr 21 20:56:00 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:00 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.info" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.info is being set with open permissions: ugo+rw Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:00 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.info Apr 21 20:56:00 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Acquiring lock "cinder-990bf5b3-dacc-4fff-b2f4-d81880301c3e-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Lock "cinder-990bf5b3-dacc-4fff-b2f4-d81880301c3e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Acquiring lock "cinder-quobyte-990bf5b3-dacc-4fff-b2f4-d81880301c3e" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-990bf5b3-dacc-4fff-b2f4-d81880301c3e" acquired by "delete_volume" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6efb8-5950-4409-8b88-d5d1f1a6714d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e Apr 21 20:56:01 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.info" returned: 0 in 0.439s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.988s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.766s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-255809192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce906af-4b45-42f8-a4f1-0968f84d18bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9761c82aea40148d1387b8edd34ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:49Z,use_quota=True,user_id='1c337d7b1ae748888d58dc02fe3f2d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Creating volume 7ce906af-4b45-42f8-a4f1-0968f84d18bb {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:01 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb 1073741824 Apr 21 20:56:01 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1f92123a-10f0-4599-9192-b1c681652c89 tempest-VolumesDeleteCascade-1750597874 None] Create snapshot completed successfully Apr 21 20:56:01 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e" returned: 0 in 0.547s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e Apr 21 20:56:01 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Flow 'volume_create_manager' (07b9c035-3f61-4295-af27-69ebe88c9949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08773db7-1b0b-44dc-afb6-036972859f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08773db7-1b0b-44dc-afb6-036972859f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1649754219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5efdf2-facc-44ba-b40c-eddfa7c47213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2053c75e39d14a63a19bc5c7cdc572c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d573121-8af2-4702-b9fd-eb96cff6af66,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:02Z,use_quota=True,user_id='1c5296e6a4ec42149d9e76f2fd62835a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccde0c26-817e-4529-8781-9918d20b0a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccde0c26-817e-4529-8781-9918d20b0a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ce666c-beba-4673-b9da-4b3b9bf5502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ce666c-beba-4673-b9da-4b3b9bf5502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f5efdf2-facc-44ba-b40c-eddfa7c47213', 'volume_name': 'volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213', 'volume_size': 1, 'snapshot_id': '9d573121-8af2-4702-b9fd-eb96cff6af66'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e704d9-1b96-46d9-82f6-e3d11f554f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e704d9-1b96-46d9-82f6-e3d11f554f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7ffd5e-44ed-4855-a74b-4b1472f26404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:01 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Volume 4f5efdf2-facc-44ba-b40c-eddfa7c47213: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213', 'volume_size': 1, 'snapshot_id': '9d573121-8af2-4702-b9fd-eb96cff6af66'} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:01 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb 1073741824" returned: 0 in 0.595s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb Apr 21 20:56:01 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-990bf5b3-dacc-4fff-b2f4-d81880301c3e" returned: 0 in 0.501s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Lock "cinder-quobyte-990bf5b3-dacc-4fff-b2f4-d81880301c3e" released by "delete_volume" :: held 1.087s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Created reservations ['88e397df-f13b-4416-a150-07ef60acc3d2', '72bd1123-d6ea-4bfd-8464-bf11f9f0c513', 'b8c39eeb-d512-4dfd-8174-b3455b195ad8', '38f299e4-5d0b-4a4c-955c-7a4c46f81568'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:02 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb" returned: 0 in 0.463s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.330s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-785517531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bbb81-7e79-452b-979c-2b542d676ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c544e29b2cfd4bee9b0685108d375576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:55Z,use_quota=True,user_id='6f48597ca7024edc90e4656b0f5f8b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Creating volume 0a6bbb81-7e79-452b-979c-2b542d676ddc {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:02 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5791809-2169-420d-a7a8-2e5cccdf05fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab222f9a-2d48-4b8a-8a3c-3b7f1b204060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:02 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc 1073741824 Apr 21 20:56:02 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Volume volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb (7ce906af-4b45-42f8-a4f1-0968f84d18bb): created successfully Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab222f9a-2d48-4b8a-8a3c-3b7f1b204060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Flow 'volume_create_manager' (4e5e95ae-2fb6-431b-866e-4398f4658db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3d0878f7-ba86-44a0-af60-8a5c5dd441eb tempest-VolumesServicesTestJSON-1472799901 None] Created volume successfully. Apr 21 20:56:02 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.432s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Deleted volume successfully. Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-cf94fa51-6f63-4bbe-ba94-3e55ee33fecd tempest-VolumesCloneTest-1725260943 None] Lock "cinder-990bf5b3-dacc-4fff-b2f4-d81880301c3e-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:02 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc 1073741824" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc Apr 21 20:56:02 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:03 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.477s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:03 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc" returned: 0 in 0.495s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.590s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-9d573121-8af2-4702-b9fd-eb96cff6af66-4f5efdf2-facc-44ba-b40c-eddfa7c47213" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dc556f-617b-41ec-b8e5-09b49f36fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6bbb81-7e79-452b-979c-2b542d676ddc', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7929312-cbea-470a-9f02-0ed22a8f0dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-9d573121-8af2-4702-b9fd-eb96cff6af66-4f5efdf2-facc-44ba-b40c-eddfa7c47213" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Creating volume 4f5efdf2-facc-44ba-b40c-eddfa7c47213 from snapshot 9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-4f5efdf2-facc-44ba-b40c-eddfa7c47213" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Volume volume-0a6bbb81-7e79-452b-979c-2b542d676ddc (0a6bbb81-7e79-452b-979c-2b542d676ddc): created successfully Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7929312-cbea-470a-9f02-0ed22a8f0dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Flow 'volume_create_manager' (b39d654c-c89d-4898-bac8-ecd8cba289d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Acquiring lock "cinder-7ce906af-4b45-42f8-a4f1-0968f84d18bb-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-8f30bcad-73b9-49f9-84f7-9d406aac9091 tempest-ServersNegativeTestJSON-2030222180 None] Created volume successfully. Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-4f5efdf2-facc-44ba-b40c-eddfa7c47213" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] snapshot: 9d573121-8af2-4702-b9fd-eb96cff6af66, volume: 4f5efdf2-facc-44ba-b40c-eddfa7c47213, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Lock "cinder-7ce906af-4b45-42f8-a4f1-0968f84d18bb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19f5c92-a007-45d3-aa33-9bcb043df173]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Acquiring lock "cinder-quobyte-7ce906af-4b45-42f8-a4f1-0968f84d18bb" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Lock "cinder-quobyte-7ce906af-4b45-42f8-a4f1-0968f84d18bb" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f62332-eaf6-4720-b876-f8c333693938]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:03 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 Apr 21 20:56:03 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:03 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb Apr 21 20:56:03 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:04 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66" returned: 0 in 0.671s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f373512d-8677-4e74-a186-fec2e4dbde35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c06b2e-e674-4b85-854a-ce6c7f996b8e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:04 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb" returned: 0 in 0.634s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:04 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb Apr 21 20:56:04 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:04 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 Apr 21 20:56:04 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:04 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7ce906af-4b45-42f8-a4f1-0968f84d18bb" returned: 0 in 0.488s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Lock "cinder-quobyte-7ce906af-4b45-42f8-a4f1-0968f84d18bb" released by "delete_volume" :: held 1.147s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Created reservations ['9ccd2243-c1b3-475a-8102-dc8c934cd6ec', '6702ab66-e948-4d5b-83a8-1c9403791751', 'bfe10655-3207-476d-85df-ef756309553e', '39c19835-3bc9-4b9c-a285-ac7bd6faa1da'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:04 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35" returned: 0 in 0.614s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:56:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:04 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:04 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:04 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 Apr 21 20:56:04 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:05 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Flow 'volume_create_manager' (0ca569fc-f6b6-45ba-ba01-3abd423a8e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6152d256-e688-4fe7-b39d-984658f4998d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.562s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6152d256-e688-4fe7-b39d-984658f4998d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-362146980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48997bcd-2350-4878-b49e-f2231e41c85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0924ce7a6d43f3b5fc14679ca89b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:05Z,use_quota=True,user_id='a6bab84cfa024178aa1d03cdddcddbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3d859b-9183-46f1-94fd-5fac2c7258b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d3d859b-9183-46f1-94fd-5fac2c7258b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2b075-1e72-4858-a611-da0f086c920b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f2b075-1e72-4858-a611-da0f086c920b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48997bcd-2350-4878-b49e-f2231e41c85d', 'volume_name': 'volume-48997bcd-2350-4878-b49e-f2231e41c85d', 'volume_size': 2}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b0ff05-ed39-466f-8bcd-919f7d8c1f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b0ff05-ed39-466f-8bcd-919f7d8c1f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f48d47-2b58-4623-a4da-f3b4edb76900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Volume 48997bcd-2350-4878-b49e-f2231e41c85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48997bcd-2350-4878-b49e-f2231e41c85d', 'volume_size': 2} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:05 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Deleted volume successfully. Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Flow 'volume_create_manager' (e54c0894-8e4c-49eb-a0a9-60b309d81f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e553f9a-8570-41fc-80b8-208c86899f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2ea8eeda-bafa-4192-86ce-e1061e2db6ac tempest-VolumesServicesTestJSON-1472799901 None] Lock "cinder-7ce906af-4b45-42f8-a4f1-0968f84d18bb-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e553f9a-8570-41fc-80b8-208c86899f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-830256785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2a62ba-1eeb-4b00-8008-fe2ca4968f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c544e29b2cfd4bee9b0685108d375576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:05Z,use_quota=True,user_id='6f48597ca7024edc90e4656b0f5f8b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288dca20-84ed-4d1a-ba63-07deca2ac7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288dca20-84ed-4d1a-ba63-07deca2ac7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7951b1b0-6eab-45fb-80d1-4ccd905e799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7951b1b0-6eab-45fb-80d1-4ccd905e799c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2a62ba-1eeb-4b00-8008-fe2ca4968f54', 'volume_name': 'volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aebff2-ae6a-4df5-8eaf-de13ade63f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61aebff2-ae6a-4df5-8eaf-de13ade63f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9292d663-cf6c-436b-a6dc-ff6fa978032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:05 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Volume ac2a62ba-1eeb-4b00-8008-fe2ca4968f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54', 'volume_size': 1} Apr 21 20:56:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:07 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213" returned: 0 in 3.005s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889dbbc-4358-4091-81b3-9d275011bee0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:07 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 Apr 21 20:56:07 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:08 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35" returned: 0 in 0.712s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:08 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35, size 1024.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:08 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Converted 1024.00 MB image at 340.60 MB/s Apr 21 20:56:08 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 is being set with open permissions: ugo+rw Apr 21 20:56:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:08 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 Apr 21 20:56:08 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213" returned: 0 in 0.479s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-4f5efdf2-facc-44ba-b40c-eddfa7c47213" released by "_copy_volume_from_snapshot" :: held 5.568s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-9d573121-8af2-4702-b9fd-eb96cff6af66-4f5efdf2-facc-44ba-b40c-eddfa7c47213" released by "_create_volume_from_snapshot" :: held 5.620s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.647s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.621s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-362146980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48997bcd-2350-4878-b49e-f2231e41c85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce0924ce7a6d43f3b5fc14679ca89b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:05Z,use_quota=True,user_id='a6bab84cfa024178aa1d03cdddcddbc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Creating volume 48997bcd-2350-4878-b49e-f2231e41c85d {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:09 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d 2147483648 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:09 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d 2147483648 Apr 21 20:56:09 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7ffd5e-44ed-4855-a74b-4b1472f26404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213', 'volume_size': 1, 'snapshot_id': '9d573121-8af2-4702-b9fd-eb96cff6af66'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7184af-b2cc-417a-b365-8650a53c4ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:09 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Volume volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 (4f5efdf2-facc-44ba-b40c-eddfa7c47213): created successfully Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7184af-b2cc-417a-b365-8650a53c4ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Flow 'volume_create_manager' (07b9c035-3f61-4295-af27-69ebe88c9949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:09 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2f6ff6f9-4539-4ef8-a0bd-75d6444a215c tempest-VolumesDeleteCascade-1750597874 None] Created volume successfully. Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-f373512d-8677-4e74-a186-fec2e4dbde35-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-f373512d-8677-4e74-a186-fec2e4dbde35-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Performing cascade delete. {{(pid=82362) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-9d573121-8af2-4702-b9fd-eb96cff6af66-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-9d573121-8af2-4702-b9fd-eb96cff6af66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-f373512d-8677-4e74-a186-fec2e4dbde35" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-f373512d-8677-4e74-a186-fec2e4dbde35" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-9d573121-8af2-4702-b9fd-eb96cff6af66" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-9d573121-8af2-4702-b9fd-eb96cff6af66" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Deleting offline snapshot 9d573121-8af2-4702-b9fd-eb96cff6af66 of volume f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] snapshot_file for this snap is: volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fcc03c-7eac-44f4-a6e3-da720ccb482d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:09 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 Apr 21 20:56:09 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d 2147483648" returned: 0 in 0.678s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:09 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d Apr 21 20:56:09 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d" returned: 0 in 0.475s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:10 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.505s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-830256785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2a62ba-1eeb-4b00-8008-fe2ca4968f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c544e29b2cfd4bee9b0685108d375576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:05Z,use_quota=True,user_id='6f48597ca7024edc90e4656b0f5f8b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Creating volume ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:10 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f48d47-2b58-4623-a4da-f3b4edb76900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48997bcd-2350-4878-b49e-f2231e41c85d', 'volume_size': 2}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b481f391-4ff9-437e-9a30-06d7ceacb928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 1073741824 Apr 21 20:56:10 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66" returned: 0 in 0.708s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f373512d-8677-4e74-a186-fec2e4dbde35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:10 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Volume volume-48997bcd-2350-4878-b49e-f2231e41c85d (48997bcd-2350-4878-b49e-f2231e41c85d): created successfully Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b481f391-4ff9-437e-9a30-06d7ceacb928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Flow 'volume_create_manager' (0ca569fc-f6b6-45ba-ba01-3abd423a8e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc19fb8-aa4a-45ba-8c4b-95611d6310d1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-0782d19a-03df-462c-a9c1-e363c568ac85 tempest-VolumesCloneNegativeTest-81666230 None] Created volume successfully. Apr 21 20:56:10 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 Apr 21 20:56:10 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 1073741824" returned: 0 in 0.659s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35" returned: 0 in 0.629s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 Apr 21 20:56:10 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 Apr 21 20:56:10 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Acquiring lock "cinder-48997bcd-2350-4878-b49e-f2231e41c85d-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Lock "cinder-48997bcd-2350-4878-b49e-f2231e41c85d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Acquiring lock "cinder-quobyte-48997bcd-2350-4878-b49e-f2231e41c85d" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Lock "cinder-quobyte-48997bcd-2350-4878-b49e-f2231e41c85d" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e97017b-d15e-411f-8e20-e0b7adc67ac2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d Apr 21 20:56:11 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54" returned: 0 in 0.617s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9292d663-cf6c-436b-a6dc-ff6fa978032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ff452c-5cd1-4f1b-bf52-96a3a2e22dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:11 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66" returned: 0 in 0.661s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Volume volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 (ac2a62ba-1eeb-4b00-8008-fe2ca4968f54): created successfully Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0ff452c-5cd1-4f1b-bf52-96a3a2e22dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:11 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66 Apr 21 20:56:11 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Flow 'volume_create_manager' (e54c0894-8e4c-49eb-a0a9-60b309d81f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-92891766-ed6c-4448-8700-30dfa14bc929 tempest-ServersNegativeTestJSON-2030222180 None] Created volume successfully. Apr 21 20:56:11 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d" returned: 0 in 0.581s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d Apr 21 20:56:11 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35.9d573121-8af2-4702-b9fd-eb96cff6af66" returned: 0 in 0.548s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "cinder-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-9d573121-8af2-4702-b9fd-eb96cff6af66" released by "_delete_snapshot" :: held 2.652s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-f373512d-8677-4e74-a186-fec2e4dbde35" released by "delete_snapshot" :: held 2.690s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:12 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "cinder-quobyte-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-48997bcd-2350-4878-b49e-f2231e41c85d" returned: 0 in 0.541s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Lock "cinder-quobyte-48997bcd-2350-4878-b49e-f2231e41c85d" released by "delete_volume" :: held 1.163s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-quobyte-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54" acquired by "delete_volume" :: waited 0.035s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Created reservations ['cd13ab52-f4f3-4f4e-98aa-caa73534f386', '1c7d10dd-7932-4cb5-8f9b-0825e2c40b11', '84553f3d-589c-4760-b269-55b90f11edc8', 'ceb96afe-1419-4019-b48c-8a147bedecd1'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a548b9-3019-4a25-9a3b-6c1678f994c1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Created reservations ['c69783cd-c367-4ac6-a33c-d596bc0c65d7', '4a2c5071-dc49-49d4-aef8-f5a09e39ce4a', '836b00fa-3d9d-48aa-b3d5-a618b3203fcb', '717ac9b7-ad61-4cbf-b365-333a18bcd4f4'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:12 devstack sudo[87550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 Apr 21 20:56:12 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Delete snapshot completed successfully. Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-9d573121-8af2-4702-b9fd-eb96cff6af66-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Snapshots deleted, issuing volume delete {{(pid=82362) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-f373512d-8677-4e74-a186-fec2e4dbde35" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-f373512d-8677-4e74-a186-fec2e4dbde35" acquired by "delete_volume" :: waited 0.048s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:12 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:12 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[683bd1c1-6bdf-41fe-b279-4aa9749627f8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 Apr 21 20:56:12 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54" returned: 0 in 0.572s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54 Apr 21 20:56:12 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.538s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:13 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Deleted volume successfully. Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-37419f71-128a-4993-93c7-f6f2c0038c8c tempest-VolumesCloneNegativeTest-81666230 None] Lock "cinder-48997bcd-2350-4878-b49e-f2231e41c85d-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:13 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35" returned: 0 in 0.618s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35 Apr 21 20:56:13 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54" returned: 0 in 0.568s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-quobyte-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54" released by "delete_volume" :: held 1.168s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Created reservations ['723fa163-4115-4d23-b808-7df43510f074', '8de85f1b-9f79-4348-bf31-760fa1db065d', 'a68f806b-1a31-4494-961c-b8d506ec8533', '76479342-e360-463b-aa75-c6ba55e8f93c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:13 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f373512d-8677-4e74-a186-fec2e4dbde35" returned: 0 in 0.573s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-f373512d-8677-4e74-a186-fec2e4dbde35" released by "delete_volume" :: held 1.242s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Created reservations ['5d300986-848b-4afd-bb31-ec020d887c29', '93113ac8-c1dc-413e-b9e8-6723aba16baf', '44a71b87-049c-4cac-be6c-5c602099f920', 'e999d89f-892d-4d8f-ba5c-571ecaa501a8'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:13 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:14 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.616s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:14 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Deleted volume successfully. Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b41c087d-ddc9-4487-9ee0-caa094999dca tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-ac2a62ba-1eeb-4b00-8008-fe2ca4968f54-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "cinder-0a6bbb81-7e79-452b-979c-2b542d676ddc-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-0a6bbb81-7e79-452b-979c-2b542d676ddc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:14 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.559s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:14 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Deleted volume successfully. Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "cinder-quobyte-0a6bbb81-7e79-452b-979c-2b542d676ddc" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5efc9ef3-0c06-4017-91ba-63c3e7319335 tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-f373512d-8677-4e74-a186-fec2e4dbde35-delete_volume" released by "delete_volume" :: held 5.007s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-quobyte-0a6bbb81-7e79-452b-979c-2b542d676ddc" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b720577e-c8d8-47e6-b4c2-98dfb45c7819]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:14 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc Apr 21 20:56:14 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-4f5efdf2-facc-44ba-b40c-eddfa7c47213-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-4f5efdf2-facc-44ba-b40c-eddfa7c47213-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:15 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "cinder-quobyte-4f5efdf2-facc-44ba-b40c-eddfa7c47213" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc" returned: 0 in 0.582s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-4f5efdf2-facc-44ba-b40c-eddfa7c47213" acquired by "delete_volume" :: waited 0.020s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:15 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc Apr 21 20:56:15 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e705720-dbdf-42e2-ab54-a5b844ebebe2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 Apr 21 20:56:15 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0a6bbb81-7e79-452b-979c-2b542d676ddc" returned: 0 in 0.563s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-quobyte-0a6bbb81-7e79-452b-979c-2b542d676ddc" released by "delete_volume" :: held 1.181s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Created reservations ['1b7ddbd8-7ddf-4b8f-9b8d-969ab7da4f76', 'db3cff01-abe3-47a6-9bdd-7b76572da0de', 'f008e847-c391-42ca-b5f2-3342ffdc741b', '2f53a0ca-e5cd-4acf-bace-89d8a18201e6'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:15 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213" returned: 0 in 0.631s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213 Apr 21 20:56:15 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:15 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (15985aa0-59b3-4a09-a30c-8161500f5775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:15 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfe69e1-f491-48de-8151-c59345074b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfe69e1-f491-48de-8151-c59345074b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1867265065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fe2397-96b1-479c-b06a-28b1e0df2089,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:16Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e50b27c-fe7e-48c3-8c30-fc54a4c67183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e50b27c-fe7e-48c3-8c30-fc54a4c67183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8962586b-bccb-4900-b5c3-35279df9b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8962586b-bccb-4900-b5c3-35279df9b644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7fe2397-96b1-479c-b06a-28b1e0df2089', 'volume_name': 'volume-b7fe2397-96b1-479c-b06a-28b1e0df2089', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bf6d93-4ae5-4a84-9ed4-c6b18a89c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7bf6d93-4ae5-4a84-9ed4-c6b18a89c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6f8a96-7deb-4ae9-97dd-44ef941f0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Volume b7fe2397-96b1-479c-b06a-28b1e0df2089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7fe2397-96b1-479c-b06a-28b1e0df2089', 'volume_size': 1} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1867265065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fe2397-96b1-479c-b06a-28b1e0df2089,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:16Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Creating volume b7fe2397-96b1-479c-b06a-28b1e0df2089 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:16 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 1073741824 Apr 21 20:56:16 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f5efdf2-facc-44ba-b40c-eddfa7c47213" returned: 0 in 0.660s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-quobyte-4f5efdf2-facc-44ba-b40c-eddfa7c47213" released by "delete_volume" :: held 1.332s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:16 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.689s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:16 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Deleted volume successfully. Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Created reservations ['d5090d63-ed0d-4da2-a077-1a6563d47a3f', '7c62e952-5ee1-415c-9a0c-6cdd139c886e', 'c3eab166-7080-41ea-865b-d36c50506d2a', 'e36cf713-8226-4e43-8cb5-9f0857d1206e'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-10a43b0e-ec67-4103-9148-31ba4c3ecd4c tempest-ServersNegativeTestJSON-2030222180 None] Lock "cinder-0a6bbb81-7e79-452b-979c-2b542d676ddc-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:16 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 1073741824" returned: 0 in 0.681s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 Apr 21 20:56:16 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:17 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Deleted volume successfully. Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e6e029ac-ed39-4cd1-821e-3d42c952daab tempest-VolumesDeleteCascade-1750597874 None] Lock "cinder-4f5efdf2-facc-44ba-b40c-eddfa7c47213-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:17 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089" returned: 0 in 0.538s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6f8a96-7deb-4ae9-97dd-44ef941f0f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fe2397-96b1-479c-b06a-28b1e0df2089', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4627b457-5e15-4b18-b42e-45a7f0fc4ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:17 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Volume volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 (b7fe2397-96b1-479c-b06a-28b1e0df2089): created successfully Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4627b457-5e15-4b18-b42e-45a7f0fc4ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (15985aa0-59b3-4a09-a30c-8161500f5775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3d8c4d39-4555-4ea4-be78-3fe42fb0d7c2 tempest-VolumesGetTest-1798135570 None] Created volume successfully. Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (2019acfa-fe0c-4f7e-bf69-a83a1186b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c99d16d-4aa6-470c-b303-e9e6f161dee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c99d16d-4aa6-470c-b303-e9e6f161dee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-63196612',display_name='tempest-VolumesGetTest-Volume-57124934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ac315f-9fae-4403-b620-d642a673ee6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:19Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a3a306-90bc-4b2c-a766-ce1a278fd82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a3a306-90bc-4b2c-a766-ce1a278fd82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2f8bf8-6200-49e7-a91b-d9b410a7f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2f8bf8-6200-49e7-a91b-d9b410a7f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ac315f-9fae-4403-b620-d642a673ee6e', 'volume_name': 'volume-35ac315f-9fae-4403-b620-d642a673ee6e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2ffcb4-ac1c-4282-82aa-53437723cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2ffcb4-ac1c-4282-82aa-53437723cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f043a291-4481-45a5-9e1e-5596b31cde19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:18 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Volume 35ac315f-9fae-4403-b620-d642a673ee6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ac315f-9fae-4403-b620-d642a673ee6e', 'volume_size': 1} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-63196612',display_name='tempest-VolumesGetTest-Volume-57124934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ac315f-9fae-4403-b620-d642a673ee6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:19Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Creating volume 35ac315f-9fae-4403-b620-d642a673ee6e {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:18 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e 1073741824 Apr 21 20:56:18 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e 1073741824" returned: 0 in 0.798s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Flow 'volume_create_manager' (3e9c9266-3795-445d-a69f-fbf3bc4856bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0485518d-2a31-4295-b55f-bd2d24c8d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e Apr 21 20:56:19 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0485518d-2a31-4295-b55f-bd2d24c8d903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-193488271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa117295-6ac8-4b4a-b905-29b623d8815d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4475d936ff8e4632987c821f983cfa17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:20Z,use_quota=True,user_id='b340e5a4f5f94e67b348c91d350b0116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4663ef42-e1f6-402c-8ab5-9b1f3d8a2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4663ef42-e1f6-402c-8ab5-9b1f3d8a2d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bfcc86-7bf4-4af0-8d7c-1b3f3f6c46dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bfcc86-7bf4-4af0-8d7c-1b3f3f6c46dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa117295-6ac8-4b4a-b905-29b623d8815d', 'volume_name': 'volume-fa117295-6ac8-4b4a-b905-29b623d8815d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9421c390-55d6-441e-9cad-06349d62384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9421c390-55d6-441e-9cad-06349d62384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a2a6fa-20c7-4724-a44d-09e1f03715f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:19 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Volume fa117295-6ac8-4b4a-b905-29b623d8815d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa117295-6ac8-4b4a-b905-29b623d8815d', 'volume_size': 1} Apr 21 20:56:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:20 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e" returned: 0 in 0.523s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-193488271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa117295-6ac8-4b4a-b905-29b623d8815d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4475d936ff8e4632987c821f983cfa17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:20Z,use_quota=True,user_id='b340e5a4f5f94e67b348c91d350b0116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Creating volume fa117295-6ac8-4b4a-b905-29b623d8815d {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:20 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f043a291-4481-45a5-9e1e-5596b31cde19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ac315f-9fae-4403-b620-d642a673ee6e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d 1073741824 Apr 21 20:56:20 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173fba3e-0c3a-479c-a530-bf417dba7be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Volume volume-35ac315f-9fae-4403-b620-d642a673ee6e (35ac315f-9fae-4403-b620-d642a673ee6e): created successfully Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173fba3e-0c3a-479c-a530-bf417dba7be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (2019acfa-fe0c-4f7e-bf69-a83a1186b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:20 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-90617ff6-5c93-46a5-aa38-9e131829d526 tempest-VolumesGetTest-1798135570 None] Created volume successfully. Apr 21 20:56:20 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d 1073741824" returned: 0 in 0.659s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:20 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d Apr 21 20:56:20 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-35ac315f-9fae-4403-b620-d642a673ee6e-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Lock "cinder-35ac315f-9fae-4403-b620-d642a673ee6e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-35ac315f-9fae-4403-b620-d642a673ee6e" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-35ac315f-9fae-4403-b620-d642a673ee6e" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d660a7-7a27-4bf0-9c40-5d31f558dae7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e Apr 21 20:56:21 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:21 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d" returned: 0 in 0.615s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a2a6fa-20c7-4724-a44d-09e1f03715f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa117295-6ac8-4b4a-b905-29b623d8815d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d28980-2205-472e-bb0a-5247b1468f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Volume volume-fa117295-6ac8-4b4a-b905-29b623d8815d (fa117295-6ac8-4b4a-b905-29b623d8815d): created successfully Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d28980-2205-472e-bb0a-5247b1468f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Flow 'volume_create_manager' (3e9c9266-3795-445d-a69f-fbf3bc4856bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d3cab68c-81e8-4cbf-a6c1-8fed8e0bcdb7 tempest-VolumesMetadataTest-586905631 None] Created volume successfully. Apr 21 20:56:21 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e" returned: 0 in 0.730s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e Apr 21 20:56:21 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Acquiring lock "cinder-fa117295-6ac8-4b4a-b905-29b623d8815d-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:22 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Lock "cinder-fa117295-6ac8-4b4a-b905-29b623d8815d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-35ac315f-9fae-4403-b620-d642a673ee6e" returned: 0 in 0.675s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-35ac315f-9fae-4403-b620-d642a673ee6e" released by "delete_volume" :: held 1.437s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Acquiring lock "cinder-quobyte-fa117295-6ac8-4b4a-b905-29b623d8815d" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Lock "cinder-quobyte-fa117295-6ac8-4b4a-b905-29b623d8815d" acquired by "delete_volume" :: waited 0.028s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[108c295c-d8c3-4cdb-8751-a678d08a5b04]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Created reservations ['5b5e8a03-e6bd-47be-9099-341ab8ecc915', '6eef5587-61ea-44c1-876d-a47750bce593', '946b0b8c-89a3-4818-852e-be90a4317595', '7b0d4182-2903-4f1d-b193-a21b5cebb2e6'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d Apr 21 20:56:22 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:22 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d" returned: 0 in 0.648s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d Apr 21 20:56:23 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.657s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Deleted volume successfully. Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5be41f1a-a555-468c-af75-295f797e0e31 tempest-VolumesGetTest-1798135570 None] Lock "cinder-35ac315f-9fae-4403-b620-d642a673ee6e-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-b7fe2397-96b1-479c-b06a-28b1e0df2089-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Lock "cinder-b7fe2397-96b1-479c-b06a-28b1e0df2089-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-b7fe2397-96b1-479c-b06a-28b1e0df2089" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-b7fe2397-96b1-479c-b06a-28b1e0df2089" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ca658-d84f-469c-8d3b-d17ddc4998ba]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 Apr 21 20:56:23 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fa117295-6ac8-4b4a-b905-29b623d8815d" returned: 0 in 0.517s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Lock "cinder-quobyte-fa117295-6ac8-4b4a-b905-29b623d8815d" released by "delete_volume" :: held 1.199s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Created reservations ['be1c7fd9-b066-4b1e-87f0-f6eb9c02dda6', '350d8105-3853-4b17-be39-988032a0d149', 'abd50538-b659-4d11-83d7-4393a91f8ca7', '2ec6da4f-c7a2-4082-ae3f-4f3eed986c4e'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:23 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089" returned: 0 in 0.743s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089 Apr 21 20:56:24 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.524s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:24 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Deleted volume successfully. Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7571854e-7caf-4dcd-9b11-b34583275a13 tempest-VolumesMetadataTest-586905631 None] Lock "cinder-fa117295-6ac8-4b4a-b905-29b623d8815d-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:24 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7fe2397-96b1-479c-b06a-28b1e0df2089" returned: 0 in 0.639s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-b7fe2397-96b1-479c-b06a-28b1e0df2089" released by "delete_volume" :: held 1.414s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Created reservations ['10f72ed0-6d28-4e78-8515-e38b43e990bb', 'c3ab8ec1-2648-4947-a610-6fbc6ce86fb0', '809720f3-b5a7-4b33-be76-e5e553000216', '9f85da7b-227f-4190-a205-14711909c188'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:24 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:25 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.536s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:25 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Deleted volume successfully. Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7aca4822-e2f2-45d6-aead-84e1e43e83f3 tempest-VolumesGetTest-1798135570 None] Lock "cinder-b7fe2397-96b1-479c-b06a-28b1e0df2089-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (265f264d-a882-4bc6-916b-574049d5ad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc5bcd9-5e2a-488e-84e2-370cbf80b9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc5bcd9-5e2a-488e-84e2-370cbf80b9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1149206072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:26Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c1f8ca-371f-4d21-8f2b-582343614f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c1f8ca-371f-4d21-8f2b-582343614f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b451f5-7888-4658-9f79-208eb8485ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b451f5-7888-4658-9f79-208eb8485ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6', 'volume_name': 'volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39c0287-916f-44da-ac66-fb141bc35782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39c0287-916f-44da-ac66-fb141bc35782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec44f77-557c-4389-978e-6e1ccdd5d325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Volume 9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6', 'volume_size': 1} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1149206072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:26Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Creating volume 9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:25 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:25 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 1073741824 Apr 21 20:56:25 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:26 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 1073741824" returned: 0 in 0.623s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 Apr 21 20:56:26 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:27 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" returned: 0 in 0.479s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec44f77-557c-4389-978e-6e1ccdd5d325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc0e59f-9c2c-43a2-ad0c-bb1bc795f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:27 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Volume volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 (9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6): created successfully Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc0e59f-9c2c-43a2-ad0c-bb1bc795f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (265f264d-a882-4bc6-916b-574049d5ad59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:27 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-68d90b9d-e926-4aec-937c-457a72e02212 tempest-VolumesGetTest-1798135570 None] Created volume successfully. Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Flow 'volume_create_manager' (2f1c64db-9e5d-4819-8cfb-d78bb379ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0846de96-37d4-404e-b65c-092d7d9f5bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0846de96-37d4-404e-b65c-092d7d9f5bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1051967866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb465cb2-ae61-4caa-9678-53efe45478ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fba2abe34048c58b6ca40dd87e0292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:28Z,use_quota=True,user_id='b919ad7584c340889a862b6cb948bd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90aca78d-64da-420f-901d-9173fb85cc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90aca78d-64da-420f-901d-9173fb85cc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91746a4-ecef-4afc-ae7d-4b5d3d1fbe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91746a4-ecef-4afc-ae7d-4b5d3d1fbe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb465cb2-ae61-4caa-9678-53efe45478ba', 'volume_name': 'volume-bb465cb2-ae61-4caa-9678-53efe45478ba', 'volume_size': 2}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7899ae01-7743-4b06-82db-923159356fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7899ae01-7743-4b06-82db-923159356fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7ebded-cf18-4311-95e0-69f43a911618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:27 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Volume bb465cb2-ae61-4caa-9678-53efe45478ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb465cb2-ae61-4caa-9678-53efe45478ba', 'volume_size': 2} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1051967866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb465cb2-ae61-4caa-9678-53efe45478ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6fba2abe34048c58b6ca40dd87e0292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:28Z,use_quota=True,user_id='b919ad7584c340889a862b6cb948bd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Creating volume bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:27 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba 2147483648 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:27 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba 2147483648 Apr 21 20:56:27 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (b81eeb1d-c12b-4066-9f19-f37af3fddc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501989c8-2e76-4d68-8fd7-f2d62a2c7f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501989c8-2e76-4d68-8fd7-f2d62a2c7f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1668308872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c127c51-e7ff-4203-8e49-bb7eca4195bd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:28Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f88df39-8cd8-4a79-bcc8-cd6f59a96b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f88df39-8cd8-4a79-bcc8-cd6f59a96b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6011b76f-8ee7-489a-9a4f-212050c99588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6011b76f-8ee7-489a-9a4f-212050c99588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3c127c51-e7ff-4203-8e49-bb7eca4195bd', 'volume_name': 'volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd', 'volume_size': 1, 'source_volid': '9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b65a207-e132-4798-9641-a39899a78ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b65a207-e132-4798-9641-a39899a78ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180275cb-f915-4768-8f04-5e18417543dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Volume 3c127c51-e7ff-4203-8e49-bb7eca4195bd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd', 'volume_size': 1, 'source_volid': '9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6', 'source_volstatus': 'available'} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:28 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba 2147483648" returned: 0 in 0.669s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba Apr 21 20:56:28 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Flow 'volume_create_manager' (13d11a99-5327-41c7-b104-94363f248e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bc8226-0537-449a-8176-165bf6dc83f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6bc8226-0537-449a-8176-165bf6dc83f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1109892464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ead1524-98bf-4a44-b915-7d2751f413c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaceee7d3d4e61b6bea71620b97a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:29Z,use_quota=True,user_id='9cd79e3c0ca1413094757e40ada36b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78fdcba-e490-4ba2-bb3b-3c5763b9f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78fdcba-e490-4ba2-bb3b-3c5763b9f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac097d7f-a6be-4d39-ab59-871bd39689e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac097d7f-a6be-4d39-ab59-871bd39689e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ead1524-98bf-4a44-b915-7d2751f413c2', 'volume_name': 'volume-3ead1524-98bf-4a44-b915-7d2751f413c2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8f52c0-5825-4ec3-afda-680ea26701af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8f52c0-5825-4ec3-afda-680ea26701af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e026b46-22bf-4baa-9fd6-7f83edd13653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Volume 3ead1524-98bf-4a44-b915-7d2751f413c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ead1524-98bf-4a44-b915-7d2751f413c2', 'volume_size': 1} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:28 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba" returned: 0 in 0.534s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.577s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:28 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Cloning volume 9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 to volume 3c127c51-e7ff-4203-8e49-bb7eca4195bd Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Creating offline snapshot 9f9f4fef-384f-46f4-bb0f-6313455c8b31 of volume 9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7ebded-cf18-4311-95e0-69f43a911618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb465cb2-ae61-4caa-9678-53efe45478ba', 'volume_size': 2}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce538cf-0822-4b3d-97a7-e47fe2e57714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae71c0-e471-4ba8-9859-a09cde2737f4]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Volume volume-bb465cb2-ae61-4caa-9678-53efe45478ba (bb465cb2-ae61-4caa-9678-53efe45478ba): created successfully Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce538cf-0822-4b3d-97a7-e47fe2e57714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Flow 'volume_create_manager' (2f1c64db-9e5d-4819-8cfb-d78bb379ce22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:29 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-8510e804-377e-4f82-b59f-bd13b0100f0e tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Created volume successfully. Apr 21 20:56:29 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 Apr 21 20:56:29 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Flow 'volume_create_manager' (385223c8-f130-4d13-9cf8-9ad6b1e6b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4f8ff3-b4cc-4b92-b5b4-cba15152106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4f8ff3-b4cc-4b92-b5b4-cba15152106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-565347343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a08aee3-075b-4e3e-a5be-d2177a2f8888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9e924bbf949a3b7da345466bc8ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:29Z,use_quota=True,user_id='4b94be97b80b4794b951a18b6d353c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585a9314-dd11-4b65-84c8-15f0ab9aceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585a9314-dd11-4b65-84c8-15f0ab9aceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfe292f-faca-4f6e-a130-c77fd7e50c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.image.glance [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Creating Keystone auth plugin from conf {{(pid=82362) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfe292f-faca-4f6e-a130-c77fd7e50c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a08aee3-075b-4e3e-a5be-d2177a2f8888', 'volume_name': 'volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2ed432-2a7b-4464-a38b-7dbb3f1c4a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2ed432-2a7b-4464-a38b-7dbb3f1c4a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e896a2c1-9a9d-4378-ac51-d9812a4412cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:29 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Volume 2a08aee3-075b-4e3e-a5be-d2177a2f8888: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Trying to clone 2a08aee3-075b-4e3e-a5be-d2177a2f8888 from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]). {{(pid=82362) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:56:29 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" returned: 0 in 0.584s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 1G Apr 21 20:56:29 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:56:29 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[605a7043-5df1-4d8d-98b4-b7c2cd17da33]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack sudo[87750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD Apr 21 20:56:29 devstack sudo[87750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:30 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 1G" returned: 0 in 0.580s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 Apr 21 20:56:30 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack sudo[87750]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD" returned: 0 in 0.616s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 is fetched for user 4b94be97b80b4794b951a18b6d353c77. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6c3d67-33b0-4dec-8467-23572a701cb6]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD Apr 21 20:56:30 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31" returned: 0 in 0.506s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 is being set with open permissions: ugo+rw Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 Apr 21 20:56:30 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:31 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31" returned: 0 in 0.477s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.info Apr 21 20:56:31 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.info" returned: 0 in 0.464s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.info is being set with open permissions: ugo+rw Apr 21 20:56:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.info Apr 21 20:56:31 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:32 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.info" returned: 0 in 0.497s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-3c127c51-e7ff-4203-8e49-bb7eca4195bd" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-3c127c51-e7ff-4203-8e49-bb7eca4195bd" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] snapshot: 9f9f4fef-384f-46f4-bb0f-6313455c8b31, volume: 3c127c51-e7ff-4203-8e49-bb7eca4195bd, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48cb194-5a66-4b4a-ba80-de19963c09a3]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:32 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 Apr 21 20:56:32 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:32 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31" returned: 0 in 0.527s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[06664870-807a-4d12-ab31-b0bac586a7ca]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:32 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 Apr 21 20:56:32 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:33 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" returned: 0 in 0.504s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:33 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:56:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd Apr 21 20:56:33 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd" returned: 0 in 2.153s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a54c107-21f4-4056-a23d-ac75a498fb44]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:35 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 Apr 21 20:56:35 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" returned: 0 in 0.637s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:36 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Converted 1024.00 MB image at 475.36 MB/s Apr 21 20:56:36 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd is being set with open permissions: ugo+rw Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd Apr 21 20:56:36 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd" returned: 0 in 0.438s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-3c127c51-e7ff-4203-8e49-bb7eca4195bd" released by "_copy_volume_from_snapshot" :: held 4.310s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-9f9f4fef-384f-46f4-bb0f-6313455c8b31" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-9f9f4fef-384f-46f4-bb0f-6313455c8b31" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Deleting offline snapshot 9f9f4fef-384f-46f4-bb0f-6313455c8b31 of volume 9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] snapshot_file for this snap is: volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff1183e-3278-4830-9b17-3febd78a3163]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 Apr 21 20:56:36 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31" returned: 0 in 0.453s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a0e6c-6add-471f-9a7a-3a9aca84d1dc]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:37 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 Apr 21 20:56:37 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:37 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:37 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 Apr 21 20:56:37 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:37 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31" returned: 0 in 0.470s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:37 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31 Apr 21 20:56:37 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6.9f9f4fef-384f-46f4-bb0f-6313455c8b31" returned: 0 in 0.414s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-9f9f4fef-384f-46f4-bb0f-6313455c8b31" released by "_delete_snapshot" :: held 1.887s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.438s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.629s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1109892464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ead1524-98bf-4a44-b915-7d2751f413c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaceee7d3d4e61b6bea71620b97a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:29Z,use_quota=True,user_id='9cd79e3c0ca1413094757e40ada36b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Creating volume 3ead1524-98bf-4a44-b915-7d2751f413c2 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:38 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 1073741824 Apr 21 20:56:38 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180275cb-f915-4768-8f04-5e18417543dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd', 'volume_size': 1, 'source_volid': '9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e279a10c-de36-48c7-8ddc-78f9ba671ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:38 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Volume volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd (3c127c51-e7ff-4203-8e49-bb7eca4195bd): created successfully Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e279a10c-de36-48c7-8ddc-78f9ba671ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (b81eeb1d-c12b-4066-9f19-f37af3fddc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:38 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ddc38ff5-23ba-40fd-a208-13e6a8991b88 tempest-VolumesGetTest-1798135570 None] Created volume successfully. Apr 21 20:56:38 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 1073741824" returned: 0 in 0.540s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 Apr 21 20:56:38 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (7287aead-c703-4ea9-ae2a-07f037fce98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cadd40b-4fa6-4e03-891d-5e62a5e4f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cadd40b-4fa6-4e03-891d-5e62a5e4f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1781342462',display_name='tempest-VolumesGetTest-Volume-79835482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52bdb7f-090d-4c80-863c-dd3b083ccb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:39Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f279ca-53a8-4b49-9dec-ea7d7cea49a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f279ca-53a8-4b49-9dec-ea7d7cea49a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a6f291-e4ab-411b-a10b-9065e53dcc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a6f291-e4ab-411b-a10b-9065e53dcc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52bdb7f-090d-4c80-863c-dd3b083ccb19', 'volume_name': 'volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a407b9-25b2-4d7d-8d7b-44c1559ad146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a407b9-25b2-4d7d-8d7b-44c1559ad146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf48af6-0169-40e6-bf56-14301576660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Volume a52bdb7f-090d-4c80-863c-dd3b083ccb19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19', 'volume_size': 1} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:39 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2" returned: 0 in 0.459s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.473s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e026b46-22bf-4baa-9fd6-7f83edd13653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ead1524-98bf-4a44-b915-7d2751f413c2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae0400c-b563-41b8-9515-6b793206eed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Creating offline snapshot a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb of volume bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:39 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Volume volume-3ead1524-98bf-4a44-b915-7d2751f413c2 (3ead1524-98bf-4a44-b915-7d2751f413c2): created successfully Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae0400c-b563-41b8-9515-6b793206eed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Flow 'volume_create_manager' (13d11a99-5327-41c7-b104-94363f248e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebf0633-f625-4904-86c0-c63591e8c06b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e058a263-a278-4324-9b17-8ada5f3fc9fb tempest-VolumesTestJSON-542810336 None] Created volume successfully. Apr 21 20:56:39 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba Apr 21 20:56:39 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:39 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba" returned: 0 in 0.480s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb 2G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:39 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb 2G Apr 21 20:56:39 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb 2G" returned: 0 in 0.537s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb465cb2-ae61-4caa-9678-53efe45478ba -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:40 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb465cb2-ae61-4caa-9678-53efe45478ba -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb Apr 21 20:56:40 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Flow 'volume_create_manager' (3684867b-ac15-495b-8423-0e04f22bc322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f78850-bb82-4b37-90c2-aca0bb280bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f78850-bb82-4b37-90c2-aca0bb280bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1859139676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db41a411-b039-45ea-9ec6-38a5eb54b543,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaceee7d3d4e61b6bea71620b97a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='9cd79e3c0ca1413094757e40ada36b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e029cea0-bd24-4ab8-9794-2d45b1c07cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e029cea0-bd24-4ab8-9794-2d45b1c07cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d27eb0-5a14-4231-ad5e-6a51c76f1207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d27eb0-5a14-4231-ad5e-6a51c76f1207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db41a411-b039-45ea-9ec6-38a5eb54b543', 'volume_name': 'volume-db41a411-b039-45ea-9ec6-38a5eb54b543', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c04f600-48eb-4675-bebe-b2e917bafebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c04f600-48eb-4675-bebe-b2e917bafebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4547ba83-106e-4b38-b8ea-b472e2304f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Volume db41a411-b039-45ea-9ec6-38a5eb54b543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db41a411-b039-45ea-9ec6-38a5eb54b543', 'volume_size': 1} Apr 21 20:56:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb465cb2-ae61-4caa-9678-53efe45478ba -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb is being set with open permissions: ugo+rw Apr 21 20:56:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:41 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb Apr 21 20:56:41 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:41 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" returned: 0 in 0.456s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:41 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.info Apr 21 20:56:41 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:41 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.info" returned: 0 in 0.427s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.info is being set with open permissions: ugo+rw Apr 21 20:56:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:41 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.info Apr 21 20:56:41 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:42 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.info" returned: 0 in 0.455s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.948s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.430s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-565347343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a08aee3-075b-4e3e-a5be-d2177a2f8888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9e924bbf949a3b7da345466bc8ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:29Z,use_quota=True,user_id='4b94be97b80b4794b951a18b6d353c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Creating volume 2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:42 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:42 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 1073741824 Apr 21 20:56:42 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:42 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5ccbb990-d704-4922-ae3c-b388851c9e80 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Create snapshot completed successfully Apr 21 20:56:42 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 1073741824" returned: 0 in 0.534s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:42 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:42 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 0 in 0.454s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.059s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1781342462',display_name='tempest-VolumesGetTest-Volume-79835482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52bdb7f-090d-4c80-863c-dd3b083ccb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:39Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Creating volume a52bdb7f-090d-4c80-863c-dd3b083ccb19 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:43 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Attempting download of ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume 2a08aee3-075b-4e3e-a5be-d2177a2f8888. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:56:43 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 1073741824 Apr 21 20:56:43 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b53b0c3-746d-45b8-ba9c-fe9562912922]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_w0jzqsnx {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "cinder-a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "cinder-quobyte-bb465cb2-ae61-4caa-9678-53efe45478ba" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-quobyte-bb465cb2-ae61-4caa-9678-53efe45478ba" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "cinder-quobyte-a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-quobyte-a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Deleting offline snapshot a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb of volume bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:43 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_w0jzqsnx Apr 21 20:56:43 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] snapshot_file for this snap is: volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db2dde7-0523-418c-856b-5c651bd6cde0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb Apr 21 20:56:43 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 1073741824" returned: 0 in 0.566s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_w0jzqsnx" returned: 0 in 0.547s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_w0jzqsnx {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 Apr 21 20:56:44 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_w0jzqsnx Apr 21 20:56:44 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb465cb2-ae61-4caa-9678-53efe45478ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42cb5d4-3966-4732-8ed0-8574d2682603]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba Apr 21 20:56:44 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_w0jzqsnx" returned: 1 in 0.470s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_w0jzqsnx' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac00088-226b-4a60-a0c4-4b4b553fec8c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19" returned: 0 in 0.447s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.638s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1859139676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db41a411-b039-45ea-9ec6-38a5eb54b543,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaceee7d3d4e61b6bea71620b97a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='9cd79e3c0ca1413094757e40ada36b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Creating volume db41a411-b039-45ea-9ec6-38a5eb54b543 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:44 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf48af6-0169-40e6-bf56-14301576660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 1073741824 Apr 21 20:56:44 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202a7e54-d37c-4e46-a335-0a2c2d6eec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD Apr 21 20:56:44 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Volume volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 (a52bdb7f-090d-4c80-863c-dd3b083ccb19): created successfully Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202a7e54-d37c-4e46-a335-0a2c2d6eec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (7287aead-c703-4ea9-ae2a-07f037fce98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-eb0fc85e-1e4c-42fc-8f4f-7e08cf77e52c tempest-VolumesGetTest-1798135570 None] Created volume successfully. Apr 21 20:56:44 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba" returned: 0 in 0.558s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb Apr 21 20:56:44 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 was qcow2, converting to raw {{(pid=82362) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:45 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 1073741824" returned: 0 in 0.555s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 Apr 21 20:56:45 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb Apr 21 20:56:45 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543" returned: 0 in 0.522s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4547ba83-106e-4b38-b8ea-b472e2304f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db41a411-b039-45ea-9ec6-38a5eb54b543', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c400ef1-7930-4548-9e70-f64497562561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Volume volume-db41a411-b039-45ea-9ec6-38a5eb54b543 (db41a411-b039-45ea-9ec6-38a5eb54b543): created successfully Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c400ef1-7930-4548-9e70-f64497562561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Flow 'volume_create_manager' (3684867b-ac15-495b-8423-0e04f22bc322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d19c0830-7ac8-4a09-8c3e-83a4d081a2e0 tempest-VolumesTestJSON-542810336 None] Created volume successfully. Apr 21 20:56:45 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba.a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" returned: 0 in 0.553s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-a52bdb7f-090d-4c80-863c-dd3b083ccb19-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Lock "cinder-a52bdb7f-090d-4c80-863c-dd3b083ccb19-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-quobyte-a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb" released by "_delete_snapshot" :: held 2.242s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-quobyte-bb465cb2-ae61-4caa-9678-53efe45478ba" released by "delete_snapshot" :: held 2.260s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-a52bdb7f-090d-4c80-863c-dd3b083ccb19" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-a52bdb7f-090d-4c80-863c-dd3b083ccb19" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe543538-8174-47cd-a96f-9de877753c72]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Created reservations ['80182d89-c07a-4b68-928b-2e0fccfa552f', '0c6a321f-f204-4e92-9d0c-618f2c3c362b', '11fab0ff-c88b-4115-b2b7-0e3515b4f418', '5a5a9070-0902-4b33-bcf4-ca5ed48867f7'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Delete snapshot completed successfully. Apr 21 20:56:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ab1ea916-a9e0-402c-8a10-a191176a7a54 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-a7d4dcf5-1298-43cb-bfc1-d6a161bdbaeb-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:45 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 Apr 21 20:56:45 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 0 in 1.042s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_n4x2blm4devstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:46 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Converted 112.00 MB image at 107.37 MB/s Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 1G Apr 21 20:56:46 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Flow 'volume_create_manager' (2286704e-5a8b-4d36-806f-65910c17512f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905e68e0-0fd0-4da9-8728-b7785a13e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905e68e0-0fd0-4da9-8728-b7785a13e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581405700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c01d1e7-75ef-4096-ab72-d06433bdd501,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaceee7d3d4e61b6bea71620b97a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:46Z,use_quota=True,user_id='9cd79e3c0ca1413094757e40ada36b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b5268c-510f-4906-8ced-2bac72e7ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b5268c-510f-4906-8ced-2bac72e7ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61340c-a002-4205-aa09-0662b4e0bf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61340c-a002-4205-aa09-0662b4e0bf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c01d1e7-75ef-4096-ab72-d06433bdd501', 'volume_name': 'volume-2c01d1e7-75ef-4096-ab72-d06433bdd501', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d306d30b-d504-4129-a4f6-8ce8d8fc8378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d306d30b-d504-4129-a4f6-8ce8d8fc8378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187686b7-641f-4061-ae62-bbc23cc4e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Volume 2c01d1e7-75ef-4096-ab72-d06433bdd501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c01d1e7-75ef-4096-ab72-d06433bdd501', 'volume_size': 1} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581405700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c01d1e7-75ef-4096-ab72-d06433bdd501,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ddaceee7d3d4e61b6bea71620b97a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:46Z,use_quota=True,user_id='9cd79e3c0ca1413094757e40ada36b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Creating volume 2c01d1e7-75ef-4096-ab72-d06433bdd501 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:46 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:46 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 1G" returned: 0 in 0.475s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19" returned: 0 in 0.652s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 1073741824 Apr 21 20:56:46 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e368eb3d-8f71-4071-9085-1f89c0af9265]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19 Apr 21 20:56:46 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:46 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "cinder-bb465cb2-ae61-4caa-9678-53efe45478ba-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-bb465cb2-ae61-4caa-9678-53efe45478ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "cinder-quobyte-bb465cb2-ae61-4caa-9678-53efe45478ba" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-quobyte-bb465cb2-ae61-4caa-9678-53efe45478ba" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dbd274-38e8-42c1-8828-56a381214582]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba Apr 21 20:56:46 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a52bdb7f-090d-4c80-863c-dd3b083ccb19" returned: 0 in 0.503s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-a52bdb7f-090d-4c80-863c-dd3b083ccb19" released by "delete_volume" :: held 1.182s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:47 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 1073741824" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Created reservations ['1e83eef4-7bff-4652-8614-7d2d883667f5', '9401ae72-2623-465a-8200-c12cda139070', '96904eb0-06ca-4072-b88a-993f2a301c15', '8d0c8ef5-ebab-4e3a-9dff-a88d40c2668b'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 Apr 21 20:56:47 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 0 in 0.596s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:47 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:47 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba" returned: 0 in 0.591s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba Apr 21 20:56:47 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.460s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Deleted volume successfully. Apr 21 20:56:47 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501" returned: 0 in 0.502s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187686b7-641f-4061-ae62-bbc23cc4e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c01d1e7-75ef-4096-ab72-d06433bdd501', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8993667d-9978-4cf7-8b09-8ba4cfcf1c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-41a643a6-2b84-443e-8056-4f00ea136e77 tempest-VolumesGetTest-1798135570 None] Lock "cinder-a52bdb7f-090d-4c80-863c-dd3b083ccb19-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:47 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Volume volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 (2c01d1e7-75ef-4096-ab72-d06433bdd501): created successfully Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8993667d-9978-4cf7-8b09-8ba4cfcf1c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Flow 'volume_create_manager' (2286704e-5a8b-4d36-806f-65910c17512f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c9002bcb-7416-4e1a-993c-6aaea7cf48d3 tempest-VolumesTestJSON-542810336 None] Created volume successfully. Apr 21 20:56:47 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 1 in 0.610s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Downloaded image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume 2a08aee3-075b-4e3e-a5be-d2177a2f8888 successfully. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 for user 4b94be97b80b4794b951a18b6d353c77 is deleted. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Marking volume 2a08aee3-075b-4e3e-a5be-d2177a2f8888 as bootable. {{(pid=82362) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Copying metadata from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 to 2a08aee3-075b-4e3e-a5be-d2177a2f8888. {{(pid=82362) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Creating volume glance metadata for volume 2a08aee3-075b-4e3e-a5be-d2177a2f8888 backed by image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82362) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e896a2c1-9a9d-4378-ac51-d9812a4412cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c6f5f0-50f9-46fa-9837-830b1c5dd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Volume volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 (2a08aee3-075b-4e3e-a5be-d2177a2f8888): created successfully Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c6f5f0-50f9-46fa-9837-830b1c5dd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Flow 'volume_create_manager' (385223c8-f130-4d13-9cf8-9ad6b1e6b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bb465cb2-ae61-4caa-9678-53efe45478ba" returned: 0 in 0.486s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-quobyte-bb465cb2-ae61-4caa-9678-53efe45478ba" released by "delete_volume" :: held 1.110s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c4abc2ee-32ec-4d82-94b2-737f0880a69a tempest-VolumesExtendTest-358142342 None] Created volume successfully. Apr 21 20:56:47 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Created reservations ['9b95c576-b7f2-4c08-932c-4fdf83198a64', 'b5d9bd08-142f-49ce-b2c6-50ca8a0dc01e', 'e4285d32-e38f-4145-8ae6-b6e4e4f0d317', 'f15cfda2-c854-4cc8-959a-8b03d12ab495'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:48 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-3c127c51-e7ff-4203-8e49-bb7eca4195bd-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Lock "cinder-3c127c51-e7ff-4203-8e49-bb7eca4195bd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-3c127c51-e7ff-4203-8e49-bb7eca4195bd" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-3c127c51-e7ff-4203-8e49-bb7eca4195bd" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d12a16f-308d-488a-bc52-5a0d7f510ef7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd Apr 21 20:56:48 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e5e499-bb2b-47c3-91fa-095b2e1f2046]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.546s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:48 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Deleted volume successfully. Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-14140560-70ab-4a74-a3c7-a73364aab823 tempest-VolumesSnapshotNegativeTestJSON-256552196 None] Lock "cinder-bb465cb2-ae61-4caa-9678-53efe45478ba-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:48 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:48 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd" returned: 0 in 0.632s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd Apr 21 20:56:48 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 0 in 0.656s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:49 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3c127c51-e7ff-4203-8e49-bb7eca4195bd" returned: 0 in 0.602s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-3c127c51-e7ff-4203-8e49-bb7eca4195bd" released by "delete_volume" :: held 1.263s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Acquiring lock "cinder-2c01d1e7-75ef-4096-ab72-d06433bdd501-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Lock "cinder-2c01d1e7-75ef-4096-ab72-d06433bdd501-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Created reservations ['7e155652-9422-4bee-a9b4-f8976c9ef171', 'd0e9d67c-40ed-46a0-9174-41a11ca1fb86', '38f055ec-e55c-4d4f-9a81-c0b2e35d9e2b', 'a4b9c4af-be21-4525-ba26-9b637c07d4db'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Acquiring lock "cinder-quobyte-2c01d1e7-75ef-4096-ab72-d06433bdd501" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Lock "cinder-quobyte-2c01d1e7-75ef-4096-ab72-d06433bdd501" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897ff9a-7ad8-4e19-88b8-3c733507b3d5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:49 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 Apr 21 20:56:49 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 1 in 0.639s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 2G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 2G" returned: 0 in 0.042s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.381s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3a6a3f10-b4a5-47e3-b15d-73f6e6c85a82 tempest-VolumesExtendTest-358142342 None] Extend volume completed successfully. Apr 21 20:56:50 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.545s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:50 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Deleted volume successfully. Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c822fd5c-2317-41f1-87c4-fa0ac0a416e4 tempest-VolumesGetTest-1798135570 None] Lock "cinder-3c127c51-e7ff-4203-8e49-bb7eca4195bd-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:50 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501" returned: 0 in 0.648s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501 Apr 21 20:56:50 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Lock "cinder-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" acquired by "delete_volume" :: waited 0.028s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46655cc2-586b-4e47-aed4-49d1126f6f4a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 Apr 21 20:56:50 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c01d1e7-75ef-4096-ab72-d06433bdd501" returned: 0 in 0.560s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Lock "cinder-quobyte-2c01d1e7-75ef-4096-ab72-d06433bdd501" released by "delete_volume" :: held 1.240s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Created reservations ['ec006059-5df2-4d3f-8c2b-51f8a66b28f5', '2b9481fc-b6f7-46ab-af42-8cc6e790510d', '4131ff90-74ea-44bf-b920-e24418488075', '2930d09c-2505-4e4a-abba-4f84e39590a7'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Acquiring lock "cinder-2a08aee3-075b-4e3e-a5be-d2177a2f8888-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Lock "cinder-2a08aee3-075b-4e3e-a5be-d2177a2f8888-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:50 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Acquiring lock "cinder-quobyte-2a08aee3-075b-4e3e-a5be-d2177a2f8888" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-2a08aee3-075b-4e3e-a5be-d2177a2f8888" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ba4cc-e0ca-4069-9ef2-c92ce0942a5e]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" returned: 0 in 0.602s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:51 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6 Apr 21 20:56:51 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (72f5a4cc-2a5b-48f1-b879-2dd202f0d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb38743-59c0-4084-af67-cb693e82f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb38743-59c0-4084-af67-cb693e82f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757592800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae76773-0c43-4011-aa45-3b95556e6310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:51Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cd5c9b-14c7-484d-9fab-5c0800692d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3cd5c9b-14c7-484d-9fab-5c0800692d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15699588-18c6-4c3f-93a8-591535ae9e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15699588-18c6-4c3f-93a8-591535ae9e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae76773-0c43-4011-aa45-3b95556e6310', 'volume_name': 'volume-5ae76773-0c43-4011-aa45-3b95556e6310', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdca54a-09ec-45dd-8fd5-42c9dc9128e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdca54a-09ec-45dd-8fd5-42c9dc9128e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193b46d0-8bee-49be-86be-4a533774f0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:51 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume 5ae76773-0c43-4011-aa45-3b95556e6310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae76773-0c43-4011-aa45-3b95556e6310', 'volume_size': 1} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-757592800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae76773-0c43-4011-aa45-3b95556e6310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:51Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Creating volume 5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:51 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 1073741824 Apr 21 20:56:51 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.569s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:51 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Deleted volume successfully. Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e64674c5-22ac-425c-a6a9-21656ae10ca4 tempest-VolumesTestJSON-542810336 None] Lock "cinder-2c01d1e7-75ef-4096-ab72-d06433bdd501-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:51 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 0 in 0.540s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Acquiring lock "cinder-db41a411-b039-45ea-9ec6-38a5eb54b543-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:51 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:51 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Lock "cinder-db41a411-b039-45ea-9ec6-38a5eb54b543-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:51 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Acquiring lock "cinder-quobyte-db41a411-b039-45ea-9ec6-38a5eb54b543" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" returned: 0 in 0.614s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Lock "cinder-quobyte-db41a411-b039-45ea-9ec6-38a5eb54b543" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6" released by "delete_volume" :: held 1.261s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa38b5d-7b21-4a71-b02b-8db3f955fc7c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Created reservations ['8050f8f0-4925-4ad8-bffc-8729d433cd26', '1850418d-b3fb-44bf-a1b2-cce661590f20', '023fd705-545d-4bb6-8473-4552c95c8ba1', '8c82d9b3-a6b5-4407-b0dd-b33ddde252c9'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:51 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 Apr 21 20:56:51 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:51 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 1073741824" returned: 0 in 0.562s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 Apr 21 20:56:51 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 1 in 0.615s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888 Apr 21 20:56:52 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543 Apr 21 20:56:52 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.560s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Deleted volume successfully. Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-22f12738-413c-4d3b-9dbb-bf498134aef2 tempest-VolumesGetTest-1798135570 None] Lock "cinder-9caaaeb1-fd2f-44fc-949b-f0fbdf2fe1c6-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:52 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310" returned: 0 in 0.440s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193b46d0-8bee-49be-86be-4a533774f0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae76773-0c43-4011-aa45-3b95556e6310', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b6938e-47ba-436d-be9b-52f392363134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume volume-5ae76773-0c43-4011-aa45-3b95556e6310 (5ae76773-0c43-4011-aa45-3b95556e6310): created successfully Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b6938e-47ba-436d-be9b-52f392363134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (72f5a4cc-2a5b-48f1-b879-2dd202f0d29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-6fc0de31-cf5c-4e26-a549-56cb70487a9c tempest-CreateVolumesFromSnapshotTest-124368197 None] Created volume successfully. Apr 21 20:56:52 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2a08aee3-075b-4e3e-a5be-d2177a2f8888" returned: 0 in 0.472s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-2a08aee3-075b-4e3e-a5be-d2177a2f8888" released by "delete_volume" :: held 1.673s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Created reservations ['3fd4692d-1876-4179-b89e-f94151770f17', '3b26c1b8-fd15-49fa-b8e1-ba3aab0d62e3', '15c8bc18-344f-43a4-8155-a2764d8eb4ca', '1cb327e7-27e8-4eb2-8f5b-3d164719b94c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:52 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-db41a411-b039-45ea-9ec6-38a5eb54b543" returned: 0 in 0.536s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Lock "cinder-quobyte-db41a411-b039-45ea-9ec6-38a5eb54b543" released by "delete_volume" :: held 1.097s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Created reservations ['a7fc40de-8c12-425f-b063-1e9a12b4d4e3', '92e693a6-1aac-4916-9387-099a2b296bcd', '42021a63-c0af-4d46-922a-eed0759fffdd', '044b110c-c5c5-42bd-8f69-8da72a9b92d4'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:52 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (dda85f82-b026-4314-9e73-918f972e7c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ec520f-fd98-4edb-aa2c-7855c1fcb688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88ec520f-fd98-4edb-aa2c-7855c1fcb688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1172934826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99883544-36ae-4ff5-b56f-0ff8249d3718,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:53Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4dd514a-689c-4749-b128-303fcbe5e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4dd514a-689c-4749-b128-303fcbe5e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7eef0e-62f0-43e8-b09a-1f2a0c60fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.image.glance [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Creating Keystone auth plugin from conf {{(pid=82362) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:56:53 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.521s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Deleted volume successfully. Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16e7eeae-97b0-4e4a-a2e9-31007b7adaa3 tempest-VolumesExtendTest-358142342 None] Lock "cinder-2a08aee3-075b-4e3e-a5be-d2177a2f8888-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7eef0e-62f0-43e8-b09a-1f2a0c60fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99883544-36ae-4ff5-b56f-0ff8249d3718', 'volume_name': 'volume-99883544-36ae-4ff5-b56f-0ff8249d3718', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c376fbe9-41fc-4d32-9d8a-909c43d3a26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c376fbe9-41fc-4d32-9d8a-909c43d3a26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f10842f-97c9-4946-8def-94741e821e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Volume 99883544-36ae-4ff5-b56f-0ff8249d3718: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99883544-36ae-4ff5-b56f-0ff8249d3718', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Trying to clone 99883544-36ae-4ff5-b56f-0ff8249d3718 from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]). {{(pid=82362) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Flow 'volume_create_manager' (adcb9f39-626d-437d-bb5d-b62f6f794233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1cc73e-a3a2-49e0-82e2-171df576bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1cc73e-a3a2-49e0-82e2-171df576bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1730825496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9e924bbf949a3b7da345466bc8ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:53Z,use_quota=True,user_id='4b94be97b80b4794b951a18b6d353c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaab4f9c-b22f-4449-b1a4-9b11cf9c9d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaab4f9c-b22f-4449-b1a4-9b11cf9c9d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23adee14-26c7-41bb-83fa-175f6bd65876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23adee14-26c7-41bb-83fa-175f6bd65876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62', 'volume_name': 'volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e70f8a3-7d4a-4f1f-ae1e-6944e16844bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e70f8a3-7d4a-4f1f-ae1e-6944e16844bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456464ad-9217-48d3-a532-d1a6c6f6b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Volume 25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62', 'volume_size': 1} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1730825496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9e924bbf949a3b7da345466bc8ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:53Z,use_quota=True,user_id='4b94be97b80b4794b951a18b6d353c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Creating volume 25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:53 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.615s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Deleted volume successfully. Apr 21 20:56:53 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 1073741824 Apr 21 20:56:53 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7483751b-e323-4992-a11f-9727c0bfd108 tempest-VolumesTestJSON-542810336 None] Lock "cinder-db41a411-b039-45ea-9ec6-38a5eb54b543-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:56:53 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41aa43d-53c3-4e1f-a8ff-2cb7c614127b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD Apr 21 20:56:53 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Acquiring lock "cinder-3ead1524-98bf-4a44-b915-7d2751f413c2-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Lock "cinder-3ead1524-98bf-4a44-b915-7d2751f413c2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Acquiring lock "cinder-quobyte-3ead1524-98bf-4a44-b915-7d2751f413c2" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Lock "cinder-quobyte-3ead1524-98bf-4a44-b915-7d2751f413c2" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[64550e7b-e615-4ed5-8a70-7fb28fb49372]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 Apr 21 20:56:53 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 1073741824" returned: 0 in 0.622s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 Apr 21 20:56:54 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 is fetched for user 51c2a9f3f9bf4558af16c19195a61dfb. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d67699-39d6-41fb-874f-72b841d5cd46]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD Apr 21 20:56:54 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2" returned: 0 in 0.544s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2 Apr 21 20:56:54 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" returned: 0 in 0.461s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.947s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Creating offline snapshot 7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c of volume 5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456464ad-9217-48d3-a532-d1a6c6f6b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a57d145-ca7b-4a0f-934d-ad5e482e8200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[150d50db-abc9-47fb-a57e-23a3d6f9f8a2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Volume volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 (25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62): created successfully Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a57d145-ca7b-4a0f-934d-ad5e482e8200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Flow 'volume_create_manager' (adcb9f39-626d-437d-bb5d-b62f6f794233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-af012b0d-71c4-416d-99f4-d3c6fa89c486 tempest-VolumesExtendTest-358142342 None] Created volume successfully. Apr 21 20:56:54 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 Apr 21 20:56:54 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:54 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3ead1524-98bf-4a44-b915-7d2751f413c2" returned: 0 in 0.473s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Lock "cinder-quobyte-3ead1524-98bf-4a44-b915-7d2751f413c2" released by "delete_volume" :: held 1.040s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Created reservations ['af08e10f-0b30-415a-a5cd-cfbb5b462630', '4c2328b5-50d1-41ff-b3f5-0b715573fe1c', '2c970480-1769-4f96-80a8-c26f145e7073', 'acd136df-6ac4-4796-a23b-24a7fe965a2a'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:56:54 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310" returned: 0 in 0.538s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c 1G Apr 21 20:56:55 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.395s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:55 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Deleted volume successfully. Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:UPDATE=252,cinder:SELECT=159,cinder:DELETE=18,cinder:INSERT=51 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-4dda0d13-8dca-4455-b9bd-0304cf0b5d93 tempest-VolumesTestJSON-542810336 None] Lock "cinder-3ead1524-98bf-4a44-b915-7d2751f413c2-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=168,cinder:UPDATE=204,cinder:INSERT=69,cinder:DELETE=22 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:55 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c 1G" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae76773-0c43-4011-aa45-3b95556e6310 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae76773-0c43-4011-aa45-3b95556e6310 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c Apr 21 20:56:55 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ae76773-0c43-4011-aa45-3b95556e6310 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c is being set with open permissions: ugo+rw Apr 21 20:56:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c Apr 21 20:56:56 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" returned: 0 in 0.537s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.info Apr 21 20:56:56 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:57 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.info" returned: 0 in 0.442s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.info is being set with open permissions: ugo+rw Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.info Apr 21 20:56:57 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:57 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.info" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.099s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.879s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1172934826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99883544-36ae-4ff5-b56f-0ff8249d3718,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:53Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Creating volume 99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:57 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:56:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a1c85372-eebf-479d-93aa-618e0bc6196d tempest-CreateVolumesFromSnapshotTest-124368197 None] Create snapshot completed successfully Apr 21 20:56:57 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 1073741824 Apr 21 20:56:57 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 1073741824" returned: 0 in 0.573s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 Apr 21 20:56:58 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718" returned: 0 in 0.493s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.145s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Attempting download of ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume 99883544-36ae-4ff5-b56f-0ff8249d3718. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Creating offline snapshot 687866a8-ea06-4f95-9254-cae6dd6b473e of volume 25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ae7dc2-8edf-4038-a250-2c9a1ea0c15b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0df0b1d-3eee-40c2-be0c-4e57022d4817]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_4rk1l2j1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 Apr 21 20:56:58 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_4rk1l2j1 Apr 21 20:56:58 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (fb5981e2-5be5-4882-b0d5-e035fb3186cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f687f94-ed31-4098-abd5-300f32c71f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f687f94-ed31-4098-abd5-300f32c71f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976885405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:59Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdadbb62-fc75-4cb3-b127-a35e3fd66b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdadbb62-fc75-4cb3-b127-a35e3fd66b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c07b68-d84d-4534-953e-349091c56ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c07b68-d84d-4534-953e-349091c56ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2', 'volume_name': 'volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55d49c6-5434-427a-b1c0-0e5fea22bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55d49c6-5434-427a-b1c0-0e5fea22bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1282c970-1636-4bd5-96c7-1bb5e6352bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume 1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2', 'volume_size': 1} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:59 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (c4f37bdc-4e81-4536-8678-31a17ade2a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015fa870-16ac-4b82-bd3e-48a780b79602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" returned: 0 in 0.680s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015fa870-16ac-4b82-bd3e-48a780b79602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637799589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d93549-6517-444b-8852-21fd27fdf517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:59Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6203162-957b-41c4-9312-1019a96ccbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6203162-957b-41c4-9312-1019a96ccbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669dbc15-a9d6-4d5d-aff5-f6f49a7fc443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669dbc15-a9d6-4d5d-aff5-f6f49a7fc443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d93549-6517-444b-8852-21fd27fdf517', 'volume_name': 'volume-f9d93549-6517-444b-8852-21fd27fdf517', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e 1G Apr 21 20:56:59 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3d3126-082b-4e74-b9ea-361f04fbf616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3d3126-082b-4e74-b9ea-361f04fbf616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d17d6cf-0e4a-4f62-9455-6642802042f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume f9d93549-6517-444b-8852-21fd27fdf517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d93549-6517-444b-8852-21fd27fdf517', 'volume_size': 1} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:59 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_4rk1l2j1" returned: 0 in 0.784s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_4rk1l2j1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_4rk1l2j1 Apr 21 20:56:59 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (45c7145c-df39-44a0-b708-0e5a54878364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9fe2b2-3376-479a-9338-2ade46caa883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9fe2b2-3376-479a-9338-2ade46caa883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-904943466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4f49a7-355a-4dd6-b61a-29791a87bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4f49a7-355a-4dd6-b61a-29791a87bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37023f98-5ecb-4cb4-9577-51e5fb4ff3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37023f98-5ecb-4cb4-9577-51e5fb4ff3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3', 'volume_name': 'volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91a565e-f0a2-4540-8731-20d6a933e2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91a565e-f0a2-4540-8731-20d6a933e2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83a8bfe-1ce1-4d5c-970e-62747a4e459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:59 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume 8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3', 'volume_size': 1} Apr 21 20:56:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (325d77c9-99b7-4722-8f2c-95e6791b6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be37a484-0644-486d-829b-d8435704d8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be37a484-0644-486d-829b-d8435704d8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154333024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45946631-42fd-4441-b8c4-196fd36a236c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8f8442-b80a-48ea-9dce-1667ee014005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8f8442-b80a-48ea-9dce-1667ee014005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfa643e-2829-47ce-b78d-e93870e7b49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cfa643e-2829-47ce-b78d-e93870e7b49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45946631-42fd-4441-b8c4-196fd36a236c', 'volume_name': 'volume-45946631-42fd-4441-b8c4-196fd36a236c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7a4d44-baa3-4216-8cef-f0e06239ed04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7a4d44-baa3-4216-8cef-f0e06239ed04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0e626f-0865-46e9-a784-fb20129df30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume 45946631-42fd-4441-b8c4-196fd36a236c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45946631-42fd-4441-b8c4-196fd36a236c', 'volume_size': 1} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:00 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e 1G" returned: 0 in 0.741s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e Apr 21 20:57:00 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:00 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (e13db663-0175-4089-a9ee-c56405fa853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae217a1-c04e-4e3d-bfed-2363a08c9539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae217a1-c04e-4e3d-bfed-2363a08c9539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976980615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e2397e-f61f-467d-9b3d-44c17fecc510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71453756-acf6-4d33-83da-bd6d2f009480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71453756-acf6-4d33-83da-bd6d2f009480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1387ab47-bfa1-4847-a2a8-a07eddaab718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1387ab47-bfa1-4847-a2a8-a07eddaab718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e2397e-f61f-467d-9b3d-44c17fecc510', 'volume_name': 'volume-c4e2397e-f61f-467d-9b3d-44c17fecc510', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a539812d-9699-4cd5-bb2c-82a5539498b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a539812d-9699-4cd5-bb2c-82a5539498b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7c2bf1-1fa5-41f2-bb36-e92ae1da0bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume c4e2397e-f61f-467d-9b3d-44c17fecc510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e2397e-f61f-467d-9b3d-44c17fecc510', 'volume_size': 1} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_4rk1l2j1" returned: 1 in 0.801s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_4rk1l2j1' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76e5893-83e6-4824-ab3f-68cc355dcbab]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD Apr 21 20:57:00 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e" returned: 0 in 0.541s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e is being set with open permissions: ugo+rw Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e Apr 21 20:57:00 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD" returned: 0 in 0.558s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 was qcow2, converting to raw {{(pid=82362) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:57:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 Apr 21 20:57:01 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e" returned: 0 in 0.487s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.info Apr 21 20:57:01 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.info" returned: 0 in 0.721s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.info is being set with open permissions: ugo+rw Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.info Apr 21 20:57:02 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718" returned: 0 in 1.270s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ad6fbcd0-c349-4cb3-b67e-6a55dfacb687_d2qnqqw_devstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:02 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Converted 112.00 MB image at 88.04 MB/s Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 1G Apr 21 20:57:02 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:02 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c8a6d091-149f-4fc4-8114-eb3a50072ec2 tempest-GroupsTest-2110072902 None] Group tempest-Group1-839746163: creating Apr 21 20:57:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c8a6d091-149f-4fc4-8114-eb3a50072ec2 tempest-GroupsTest-2110072902 None] Group tempest-Group1-839746163: created successfully Apr 21 20:57:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c8a6d091-149f-4fc4-8114-eb3a50072ec2 tempest-GroupsTest-2110072902 None] Create group completed successfully. Apr 21 20:57:02 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.info" returned: 0 in 0.648s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.911s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.454s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976885405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:59Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Creating volume 1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:02 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 1073741824 Apr 21 20:57:02 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-8118a59c-e5d2-4217-9eb0-1f5d455c1bfc tempest-VolumesExtendTest-358142342 None] Create snapshot completed successfully Apr 21 20:57:02 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 1G" returned: 0 in 0.587s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3600d404-27d5-46b4-a86b-8ea7f06899a6]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:02 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 Apr 21 20:57:02 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.554s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:03 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 1073741824" returned: 0 in 0.548s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 Apr 21 20:57:03 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718" returned: 0 in 0.616s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 Apr 21 20:57:03 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2" returned: 0 in 0.501s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.223s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1637799589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d93549-6517-444b-8852-21fd27fdf517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:59Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Creating volume f9d93549-6517-444b-8852-21fd27fdf517 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:03 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 1073741824 Apr 21 20:57:03 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1282c970-1636-4bd5-96c7-1bb5e6352bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6206a8-d75c-432c-8758-1c28bf6684e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d132b07f-9873-41f5-a8f3-f9135e3ab2ca tempest-GroupsTest-2110072902 None] Group tempest-Group2-817220033: creating Apr 21 20:57:03 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 (1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2): created successfully Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6206a8-d75c-432c-8758-1c28bf6684e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:03 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (fb5981e2-5be5-4882-b0d5-e035fb3186cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-6be4065b-bf2d-415f-8c51-bbd49114a188 tempest-CreateVolumesFromSnapshotTest-124368197 None] Created volume successfully. Apr 21 20:57:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d132b07f-9873-41f5-a8f3-f9135e3ab2ca tempest-GroupsTest-2110072902 None] Group tempest-Group2-817220033: created successfully Apr 21 20:57:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d132b07f-9873-41f5-a8f3-f9135e3ab2ca tempest-GroupsTest-2110072902 None] Create group completed successfully. Apr 21 20:57:04 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718" returned: 1 in 0.594s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Downloaded image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 ((None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}])) to volume 99883544-36ae-4ff5-b56f-0ff8249d3718 successfully. {{(pid=82362) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Temporary image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 for user 51c2a9f3f9bf4558af16c19195a61dfb is deleted. {{(pid=82362) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.volume_utils [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Marking volume 99883544-36ae-4ff5-b56f-0ff8249d3718 as bootable. {{(pid=82362) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Copying metadata from image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 to 99883544-36ae-4ff5-b56f-0ff8249d3718. {{(pid=82362) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Creating volume glance metadata for volume 99883544-36ae-4ff5-b56f-0ff8249d3718 backed by image ad6fbcd0-c349-4cb3-b67e-6a55dfacb687 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82362) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f10842f-97c9-4946-8def-94741e821e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99883544-36ae-4ff5-b56f-0ff8249d3718', 'volume_size': 1, 'image_id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '829db22f82844eb2a8ba6c51482cac8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ad6fbcd0-c349-4cb3-b67e-6a55dfacb687', 'created_at': datetime.datetime(2026, 4, 21, 18, 47, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ad6fbcd0-c349-4cb3-b67e-6a55dfacb687/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb19f1a-e9a4-483e-8eca-c6b640b45b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:04 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Volume volume-99883544-36ae-4ff5-b56f-0ff8249d3718 (99883544-36ae-4ff5-b56f-0ff8249d3718): created successfully Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb19f1a-e9a4-483e-8eca-c6b640b45b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (dda85f82-b026-4314-9e73-918f972e7c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:04 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9af322c2-0632-463b-96ec-9b9a37e6cae7 tempest-VolumesGetTest-1798135570 None] Created volume successfully. Apr 21 20:57:04 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 1073741824" returned: 0 in 0.542s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 Apr 21 20:57:04 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517" returned: 0 in 0.477s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-904943466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Creating volume 8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:04 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d17d6cf-0e4a-4f62-9455-6642802042f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d93549-6517-444b-8852-21fd27fdf517', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e72fa20-f060-4f59-95df-c72097646231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:04 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 1073741824 Apr 21 20:57:04 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume volume-f9d93549-6517-444b-8852-21fd27fdf517 (f9d93549-6517-444b-8852-21fd27fdf517): created successfully Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e72fa20-f060-4f59-95df-c72097646231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (c4f37bdc-4e81-4536-8678-31a17ade2a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:04 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5f7af4a1-b3c1-443c-903a-d12d0af91c25 tempest-CreateVolumesFromSnapshotTest-124368197 None] Created volume successfully. Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (d3d3c196-e0d1-42a0-838c-0c0e9163cad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06998df4-29d3-4543-8e6d-8c0339c02d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06998df4-29d3-4543-8e6d-8c0339c02d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1071160636',display_name='tempest-VolumesGetTest-Volume-1940746769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e260836a-4f01-4b3a-a800-c838c509809b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baf0e48-f5b7-4a67-b7ab-988d47896aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baf0e48-f5b7-4a67-b7ab-988d47896aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e526ac61-485f-4309-8563-996a7b519486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e526ac61-485f-4309-8563-996a7b519486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e260836a-4f01-4b3a-a800-c838c509809b', 'volume_name': 'volume-e260836a-4f01-4b3a-a800-c838c509809b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccb4059-0839-4029-a02a-87e7cbf90093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccb4059-0839-4029-a02a-87e7cbf90093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c775c5-45cc-4769-9776-8ab1980b2c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Volume e260836a-4f01-4b3a-a800-c838c509809b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e260836a-4f01-4b3a-a800-c838c509809b', 'volume_size': 1} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Flow 'volume_create_manager' (8a7d4638-b6c7-4962-bacc-a650ab1c5307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47384cf6-3984-4f19-89b3-9332d1428f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47384cf6-3984-4f19-89b3-9332d1428f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252817097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3040303-e007-48c3-910f-f801ddfb6072,host='devstack@QuobyteHD#QuobyteHD',id=5f856293-3921-46fc-997c-b41bb7642192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69df25464761486e8d0a60d04406e0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='f9166506930c497287b519c5c35a400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e0df327-161e-4c3f-8300-f744717a8be8),volume_type_id=4e0df327-161e-4c3f-8300-f744717a8be8)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496b042f-c53d-4f42-a1d3-13ecf91ce77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496b042f-c53d-4f42-a1d3-13ecf91ce77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234fc11f-fc2b-40cb-a7b1-a5a1687de9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234fc11f-fc2b-40cb-a7b1-a5a1687de9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f856293-3921-46fc-997c-b41bb7642192', 'volume_name': 'volume-5f856293-3921-46fc-997c-b41bb7642192', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d561b3-a1f8-4ddc-b734-6ad92dab202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d561b3-a1f8-4ddc-b734-6ad92dab202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a48af1-5aa6-4548-a64d-d722707063c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Volume 5f856293-3921-46fc-997c-b41bb7642192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f856293-3921-46fc-997c-b41bb7642192', 'volume_size': 1} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:05 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 1073741824" returned: 0 in 0.576s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 Apr 21 20:57:05 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3" returned: 0 in 0.419s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.737s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154333024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45946631-42fd-4441-b8c4-196fd36a236c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Creating volume 45946631-42fd-4441-b8c4-196fd36a236c {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:05 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83a8bfe-1ce1-4d5c-970e-62747a4e459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa37605-a694-40c6-a1b2-906d5c1540f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c 1073741824 Apr 21 20:57:05 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 (8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3): created successfully Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa37605-a694-40c6-a1b2-906d5c1540f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (45c7145c-df39-44a0-b708-0e5a54878364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:05 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9ec1a06f-e434-43e8-b41b-9bee078aa180 tempest-CreateVolumesFromSnapshotTest-124368197 None] Created volume successfully. Apr 21 20:57:06 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c 1073741824" returned: 0 in 0.493s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c Apr 21 20:57:06 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.379s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976980615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e2397e-f61f-467d-9b3d-44c17fecc510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bc7fbeb0904dddac998ba7cc59f0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='7bc6b349fea64b42827d3cbdda034fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Creating volume c4e2397e-f61f-467d-9b3d-44c17fecc510 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:06 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0e626f-0865-46e9-a784-fb20129df30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45946631-42fd-4441-b8c4-196fd36a236c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 1073741824 Apr 21 20:57:06 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4fc4d-40e8-41d4-a88a-99a99bd5a78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume volume-45946631-42fd-4441-b8c4-196fd36a236c (45946631-42fd-4441-b8c4-196fd36a236c): created successfully Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d4fc4d-40e8-41d4-a88a-99a99bd5a78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (325d77c9-99b7-4722-8f2c-95e6791b6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2552979a-e9f1-4736-9341-5b254e8816e4 tempest-CreateVolumesFromSnapshotTest-124368197 None] Created volume successfully. Apr 21 20:57:07 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 1073741824" returned: 0 in 0.513s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 Apr 21 20:57:07 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510" returned: 0 in 0.481s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.884s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7c2bf1-1fa5-41f2-bb36-e92ae1da0bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e2397e-f61f-467d-9b3d-44c17fecc510', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e1448-4b6e-4fa3-8655-bd2d5a1fd0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7e9a0-977c-42a3-98b9-e79eddcffe0f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Volume volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 (c4e2397e-f61f-467d-9b3d-44c17fecc510): created successfully Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9e1448-4b6e-4fa3-8655-bd2d5a1fd0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Flow 'volume_create_manager' (e13db663-0175-4089-a9ee-c56405fa853e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:07 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-cf6cd296-8404-4abd-986a-b72135ac5dda tempest-CreateVolumesFromSnapshotTest-124368197 None] Created volume successfully. Apr 21 20:57:07 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 Apr 21 20:57:07 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" returned: 0 in 0.540s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e 2G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e 2G" returned: 0 in 0.078s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.653s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.234s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1071160636',display_name='tempest-VolumesGetTest-Volume-1940746769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e260836a-4f01-4b3a-a800-c838c509809b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a3feeca40f4eb28d16dd8944d22ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='51c2a9f3f9bf4558af16c19195a61dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Creating volume e260836a-4f01-4b3a-a800-c838c509809b {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:08 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b 1073741824 Apr 21 20:57:08 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ab15fe46-3248-42ad-8599-e1963ae1fb2e tempest-VolumesExtendTest-358142342 None] Extend volume completed successfully. Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-c4e2397e-f61f-467d-9b3d-44c17fecc510-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-c4e2397e-f61f-467d-9b3d-44c17fecc510-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-c4e2397e-f61f-467d-9b3d-44c17fecc510" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-c4e2397e-f61f-467d-9b3d-44c17fecc510" acquired by "delete_volume" :: waited 0.023s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19a5cd-0c00-4e37-81ba-420387b2a794]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b 1073741824" returned: 0 in 0.551s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 Apr 21 20:57:09 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b Apr 21 20:57:09 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Acquiring lock "cinder-687866a8-ea06-4f95-9254-cae6dd6b473e-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Lock "cinder-687866a8-ea06-4f95-9254-cae6dd6b473e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Acquiring lock "cinder-quobyte-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Acquiring lock "cinder-quobyte-687866a8-ea06-4f95-9254-cae6dd6b473e" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-687866a8-ea06-4f95-9254-cae6dd6b473e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Deleting offline snapshot 687866a8-ea06-4f95-9254-cae6dd6b473e of volume 25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] snapshot_file for this snap is: volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb90bb9-7987-4a51-9365-669c094095e5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510" returned: 0 in 0.560s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e Apr 21 20:57:09 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510 Apr 21 20:57:09 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b" returned: 0 in 0.548s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.314s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3040303-e007-48c3-910f-f801ddfb6072,created_at=2026-04-21T18:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1252817097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3040303-e007-48c3-910f-f801ddfb6072,host='devstack@QuobyteHD#QuobyteHD',id=5f856293-3921-46fc-997c-b41bb7642192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69df25464761486e8d0a60d04406e0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='f9166506930c497287b519c5c35a400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e0df327-161e-4c3f-8300-f744717a8be8),volume_type_id=4e0df327-161e-4c3f-8300-f744717a8be8)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Creating volume 5f856293-3921-46fc-997c-b41bb7642192 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:09 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c775c5-45cc-4769-9776-8ab1980b2c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e260836a-4f01-4b3a-a800-c838c509809b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 1073741824 Apr 21 20:57:09 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eab3ec-1472-4ac3-8b0a-6181ea301596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Volume volume-e260836a-4f01-4b3a-a800-c838c509809b (e260836a-4f01-4b3a-a800-c838c509809b): created successfully Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51eab3ec-1472-4ac3-8b0a-6181ea301596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Flow 'volume_create_manager' (d3d3c196-e0d1-42a0-838c-0c0e9163cad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:09 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7a76cfbc-ccca-4cae-8f48-2aeecfa42d38 tempest-VolumesGetTest-1798135570 None] Created volume successfully. Apr 21 20:57:09 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c4e2397e-f61f-467d-9b3d-44c17fecc510" returned: 0 in 0.435s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-c4e2397e-f61f-467d-9b3d-44c17fecc510" released by "delete_volume" :: held 1.020s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Created reservations ['d9fc6488-5294-4675-ba38-5caa897c08f1', '417e5e6b-93c7-49b5-9bce-f6cd296fe094', '1987d9eb-0e12-4817-a7e5-ec47aed7924f', '449ccc02-0d4e-4df1-b6bb-27c39e0d5546'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:10 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e" returned: 0 in 0.599s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2980cd4c-35d8-49ea-8d00-ef0a23730f0d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:10 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 Apr 21 20:57:10 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 1073741824" returned: 0 in 0.570s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 Apr 21 20:57:10 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-e260836a-4f01-4b3a-a800-c838c509809b-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Lock "cinder-e260836a-4f01-4b3a-a800-c838c509809b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:10 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" returned: 0 in 0.591s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.578s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:10 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e Apr 21 20:57:10 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-e260836a-4f01-4b3a-a800-c838c509809b" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:10 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Deleted volume successfully. Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-e260836a-4f01-4b3a-a800-c838c509809b" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9964f904-f5c7-4bd2-9e1d-63099cb09a2f tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-c4e2397e-f61f-467d-9b3d-44c17fecc510-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef3bfa0-60bf-4963-9ab3-65b91dcc1c81]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192" returned: 0 in 0.530s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a48af1-5aa6-4548-a64d-d722707063c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f856293-3921-46fc-997c-b41bb7642192', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6635fdb9-dadc-486b-8d5b-b16ef353a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:10 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Volume volume-5f856293-3921-46fc-997c-b41bb7642192 (5f856293-3921-46fc-997c-b41bb7642192): created successfully Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6635fdb9-dadc-486b-8d5b-b16ef353a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Flow 'volume_create_manager' (8a7d4638-b6c7-4962-bacc-a650ab1c5307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:10 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7bbea90b-28bd-4b3b-95b0-7dc667a79552 tempest-GroupsTest-2110072902 None] Created volume successfully. Apr 21 20:57:10 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b Apr 21 20:57:10 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-45946631-42fd-4441-b8c4-196fd36a236c-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-45946631-42fd-4441-b8c4-196fd36a236c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-45946631-42fd-4441-b8c4-196fd36a236c" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-45946631-42fd-4441-b8c4-196fd36a236c" acquired by "delete_volume" :: waited 0.020s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f66de-b50a-4332-8803-41e6ef8cbd17]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e" returned: 0 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e Apr 21 20:57:11 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c Apr 21 20:57:11 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b" returned: 0 in 0.582s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b Apr 21 20:57:11 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62.687866a8-ea06-4f95-9254-cae6dd6b473e" returned: 0 in 0.475s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-687866a8-ea06-4f95-9254-cae6dd6b473e" released by "_delete_snapshot" :: held 2.283s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" released by "delete_snapshot" :: held 2.299s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:11 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c" returned: 0 in 0.593s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c Apr 21 20:57:11 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Created reservations ['69c7df25-d889-4d38-a4e6-64ef3b929674', '78d2378a-ed01-4ad1-ba72-5dcbfb7d9f1d', '0124e3f0-81bc-4d80-9524-7f3687628b89', '73560bc3-49ac-48f7-9171-f1578ad0d642'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:11 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-e260836a-4f01-4b3a-a800-c838c509809b" returned: 0 in 0.489s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-e260836a-4f01-4b3a-a800-c838c509809b" released by "delete_volume" :: held 1.104s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Delete snapshot completed successfully. Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-589d9dac-6dbd-45b6-9f0e-1e2db82492c9 tempest-VolumesExtendTest-358142342 None] Lock "cinder-687866a8-ea06-4f95-9254-cae6dd6b473e-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Created reservations ['b925ea2d-c538-4f3a-aa53-2c2626a4f45c', 'a93f31db-1b5a-432e-bc45-f6cc19ccde95', '37e6c319-0507-4cbe-b574-dfb4cd4da1e2', 'ce9c69c8-aedd-46e2-b885-98c7d99681e6'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:12 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Acquiring lock "cinder-quobyte-5f856293-3921-46fc-997c-b41bb7642192" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Lock "cinder-quobyte-5f856293-3921-46fc-997c-b41bb7642192" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[439d7ded-614e-4286-83f9-8c694108d7ed]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack sudo[88310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 Apr 21 20:57:12 devstack sudo[88310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-45946631-42fd-4441-b8c4-196fd36a236c" returned: 0 in 0.540s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-45946631-42fd-4441-b8c4-196fd36a236c" released by "delete_volume" :: held 1.156s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Created reservations ['159caf09-314d-44c9-9cf0-63f5fa721d84', '485360ce-9be7-49a1-b35b-6a5c8959e176', '4a191d42-74ed-4d3f-8596-951c322ed222', '376157ad-40a5-4ac0-8e88-455d6882008d'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:12 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.485s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:12 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Deleted volume successfully. Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48f4eaee-0a2a-4e7a-82d7-ebcbb8619962 tempest-VolumesGetTest-1798135570 None] Lock "cinder-e260836a-4f01-4b3a-a800-c838c509809b-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:12 devstack sudo[88310]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Acquiring lock "cinder-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Lock "cinder-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:12 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192 Apr 21 20:57:12 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Acquiring lock "cinder-quobyte-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" acquired by "delete_volume" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cbbb8a-76a4-4aa0-941b-9afbebfade74]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 Apr 21 20:57:12 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-99883544-36ae-4ff5-b56f-0ff8249d3718-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Lock "cinder-99883544-36ae-4ff5-b56f-0ff8249d3718-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Acquiring lock "cinder-quobyte-99883544-36ae-4ff5-b56f-0ff8249d3718" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:12 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.555s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-99883544-36ae-4ff5-b56f-0ff8249d3718" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:12 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Deleted volume successfully. Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5de92daf-745d-4088-b679-bc01f19baf76 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-45946631-42fd-4441-b8c4-196fd36a236c-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4396a1-28b9-4292-a0dc-7a27a6940335]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 Apr 21 20:57:13 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5f856293-3921-46fc-997c-b41bb7642192" returned: 0 in 0.509s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Lock "cinder-quobyte-5f856293-3921-46fc-997c-b41bb7642192" released by "delete_volume" :: held 1.087s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Created reservations ['6528f4ed-b029-4b71-a055-bafc76b8615a'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:13 devstack cinder-volume[82362]: WARNING cinder.quota [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1724362351 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1724362351, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:13 devstack cinder-volume[82362]: WARNING cinder.quota [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1724362351 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1724362351, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Created reservations ['8bbb5154-1939-45be-92ae-7f2b44d73ae2', 'b22b6dca-f04c-4281-849d-be5966b3707f', '409bd858-3af5-4a88-938a-e882ce587187', '6fed2c74-9932-4868-bc87-3de863581194'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:13 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" returned: 0 in 0.648s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:13 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62 Apr 21 20:57:13 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3" acquired by "delete_volume" :: waited 0.032s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:13 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:13 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f39c6f-2430-4df2-b394-20b41315f648]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 Apr 21 20:57:13 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718" returned: 0 in 0.624s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 Apr 21 20:57:13 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" returned: 0 in 0.531s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Lock "cinder-quobyte-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62" released by "delete_volume" :: held 1.210s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Created reservations ['67844414-5878-486a-923e-029b53ddaa0c', '00866685-eec1-4914-b8e7-f726ba798202', '44ef0752-6045-43ec-82d1-247c5655627e', '0aaaddee-aa58-4fde-b098-94775b542277'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:13 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.558s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3ab586ce-9a9f-4d87-af60-350e53803e18 tempest-GroupsTest-2110072902 None] Delete group completed successfully. Apr 21 20:57:14 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:14 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3" returned: 0 in 0.624s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3 Apr 21 20:57:14 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718" returned: 1 in 0.550s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718 Apr 21 20:57:14 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Created reservations ['c6759bab-538e-43bc-8a4c-52a926c3f205'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:14 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.537s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:14 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Deleted volume successfully. Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f6fde579-ea32-45bd-9810-6a84c817de05 tempest-VolumesExtendTest-358142342 None] Lock "cinder-25bdbca0-6ea3-4a2a-a005-e0b3d5b19f62-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:14 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3" returned: 0 in 0.502s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3" released by "delete_volume" :: held 1.149s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Created reservations ['a3373bfd-1d0f-440a-9ea9-1746010262cb', 'eaae0410-ee2f-4efd-ae61-8e7ea13ff6c5', '8c082d2e-151b-42be-b210-7747c543b222', '726e06f3-81b5-49b3-9528-b7f555bcddac'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:14 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-99883544-36ae-4ff5-b56f-0ff8249d3718" returned: 0 in 0.547s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Lock "cinder-quobyte-99883544-36ae-4ff5-b56f-0ff8249d3718" released by "delete_volume" :: held 1.769s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Created reservations ['539e4d3c-b5cd-4dbf-bb8f-d72fdfb65fb4', '1cf60662-9cd8-4d12-86a8-d0b4437171c6', 'ad063d5a-0241-4346-8621-71c77bee10a7', '6c5f4bcb-fe8f-46cc-a42b-af37f34cbb4f'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:14 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.600s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7473f680-f3ed-44df-a5b6-17059b72c0bf tempest-GroupsTest-2110072902 None] Delete group completed successfully. Apr 21 20:57:15 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.461s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Deleted volume successfully. Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b19b0e7f-dcbb-4315-bd09-d6a1da618b3b tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-8dc5ecd7-302d-4e02-8fdd-3cffb7e14cf3-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:15 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.503s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Deleted volume successfully. Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ee5e7bac-7619-43eb-865a-ef7b1c96e472 tempest-VolumesGetTest-1798135570 None] Lock "cinder-99883544-36ae-4ff5-b56f-0ff8249d3718-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-f9d93549-6517-444b-8852-21fd27fdf517-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-f9d93549-6517-444b-8852-21fd27fdf517-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-f9d93549-6517-444b-8852-21fd27fdf517" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-f9d93549-6517-444b-8852-21fd27fdf517" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd1714-40df-43da-a5ae-3d21bc0d41b0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:15 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 Apr 21 20:57:15 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1cc35c34-0073-4b04-88e0-0883749c509d tempest-GroupsTest-2110072902 None] Group tempest-GroupsTest-Group-569985917: creating Apr 21 20:57:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1cc35c34-0073-4b04-88e0-0883749c509d tempest-GroupsTest-2110072902 None] Group tempest-GroupsTest-Group-569985917: created successfully Apr 21 20:57:15 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1cc35c34-0073-4b04-88e0-0883749c509d tempest-GroupsTest-2110072902 None] Create group completed successfully. Apr 21 20:57:16 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517" returned: 0 in 0.658s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517 Apr 21 20:57:16 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f9d93549-6517-444b-8852-21fd27fdf517" returned: 0 in 0.503s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-f9d93549-6517-444b-8852-21fd27fdf517" released by "delete_volume" :: held 1.197s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Created reservations ['a764bc27-5ddd-4123-af96-5feebfe0ae7b', 'f7e5b454-5582-4e28-a399-a4c340f32008', '475d8961-c831-46ef-9b2c-16c18fcd42c4', 'de3e5668-27c6-442a-a0f1-6d4f00d16d29'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:16 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Flow 'volume_create_manager' (1db821c3-8979-47c7-93cb-84dba11315cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f659a86f-7c75-4e18-8e63-416c45663f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f659a86f-7c75-4e18-8e63-416c45663f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-863327306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deaea446-c5c1-472b-87ec-bb027365644d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b68f1622981d4733aaf7c22457d781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:17Z,use_quota=True,user_id='fde5bb738d8549a4a77db10fa3cabae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e936c-3d9f-4f12-b614-1c8cb01bcb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e936c-3d9f-4f12-b614-1c8cb01bcb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69896690-90be-4aad-b972-b9a16f2976e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69896690-90be-4aad-b972-b9a16f2976e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deaea446-c5c1-472b-87ec-bb027365644d', 'volume_name': 'volume-deaea446-c5c1-472b-87ec-bb027365644d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9010794-d8ac-47af-ac49-dc83228e0dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9010794-d8ac-47af-ac49-dc83228e0dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf94bc26-3e28-4302-8f78-3f963ff1d6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Volume deaea446-c5c1-472b-87ec-bb027365644d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deaea446-c5c1-472b-87ec-bb027365644d', 'volume_size': 1} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-863327306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deaea446-c5c1-472b-87ec-bb027365644d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b68f1622981d4733aaf7c22457d781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:17Z,use_quota=True,user_id='fde5bb738d8549a4a77db10fa3cabae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Creating volume deaea446-c5c1-472b-87ec-bb027365644d {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:17 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d 1073741824 Apr 21 20:57:17 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Flow 'volume_create_manager' (c434418a-d35a-476e-9285-beeb851c501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ebfd02-7db2-41ca-b007-f822dc093f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ebfd02-7db2-41ca-b007-f822dc093f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327677800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c84d0a60-80b1-4cb6-a52b-fc94f937621f,host='devstack@QuobyteHD#QuobyteHD',id=9f02b4af-bc95-42f2-9c40-9e42ac138fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69df25464761486e8d0a60d04406e0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:17Z,use_quota=True,user_id='f9166506930c497287b519c5c35a400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2071bf70-0741-431a-b905-92b315014dbe),volume_type_id=2071bf70-0741-431a-b905-92b315014dbe)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e717be-d91b-420e-80d3-72eea85dba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e717be-d91b-420e-80d3-72eea85dba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e40ac7-dcb8-4fec-83b3-1cb604265b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e40ac7-dcb8-4fec-83b3-1cb604265b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f02b4af-bc95-42f2-9c40-9e42ac138fc7', 'volume_name': 'volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ab72a6-dc0e-4e70-a0a3-6b867c19a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ab72a6-dc0e-4e70-a0a3-6b867c19a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993631f4-089e-47dd-a0c2-8a73d6e7fe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:17 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Volume 9f02b4af-bc95-42f2-9c40-9e42ac138fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7', 'volume_size': 1} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:17 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.502s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Deleted volume successfully. Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29ab78c6-4b73-4468-b1d8-319042ad3c3d tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-f9d93549-6517-444b-8852-21fd27fdf517-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:17 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d 1073741824" returned: 0 in 0.576s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d Apr 21 20:57:17 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[70732a6f-2437-4af2-80d5-36eb4844b1c9]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 Apr 21 20:57:17 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d" returned: 0 in 0.476s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.897s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c84d0a60-80b1-4cb6-a52b-fc94f937621f,created_at=2026-04-21T18:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327677800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c84d0a60-80b1-4cb6-a52b-fc94f937621f,host='devstack@QuobyteHD#QuobyteHD',id=9f02b4af-bc95-42f2-9c40-9e42ac138fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69df25464761486e8d0a60d04406e0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:17Z,use_quota=True,user_id='f9166506930c497287b519c5c35a400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2071bf70-0741-431a-b905-92b315014dbe),volume_type_id=2071bf70-0741-431a-b905-92b315014dbe)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Creating volume 9f02b4af-bc95-42f2-9c40-9e42ac138fc7 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:18 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf94bc26-3e28-4302-8f78-3f963ff1d6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deaea446-c5c1-472b-87ec-bb027365644d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff653780-f225-4e23-abd6-149c45427e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:18 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 1073741824 Apr 21 20:57:18 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Volume volume-deaea446-c5c1-472b-87ec-bb027365644d (deaea446-c5c1-472b-87ec-bb027365644d): created successfully Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff653780-f225-4e23-abd6-149c45427e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Flow 'volume_create_manager' (1db821c3-8979-47c7-93cb-84dba11315cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:18 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1dc89d96-a94f-46f2-971f-9ff21d912e4c tempest-VolumesListTestJSON-109064470 None] Created volume successfully. Apr 21 20:57:18 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2" returned: 0 in 0.544s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2 Apr 21 20:57:18 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 1073741824" returned: 0 in 0.560s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2" returned: 0 in 0.452s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2" released by "delete_volume" :: held 1.027s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 Apr 21 20:57:18 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Created reservations ['30a73edf-e123-4dfa-966a-03944f0b8e8c', 'cc19053b-6b86-4c31-8650-eb97e60ee356', '73f5cd8a-57a7-48d7-a341-6b250188d4a5', '65bb3d82-fa4f-4327-ba68-0598f5d56458'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:19 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.462s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Deleted volume successfully. Apr 21 20:57:19 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7" returned: 0 in 0.580s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Flow 'volume_create_manager' (cb18d2eb-cc29-4947-9fec-4ff813b03a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e55a604-b344-4057-89ad-4bfb6a7e9fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c94f7c70-26aa-4767-8759-d19626e9ce18 tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-1a97dd98-dc36-4cb8-a89b-b8edd6e66dd2-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993631f4-089e-47dd-a0c2-8a73d6e7fe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d5de7b-7de8-4d4a-9ff6-65b12fc4bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e55a604-b344-4057-89ad-4bfb6a7e9fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-192253573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b032bdf-e5f8-47b6-818e-ad5e70b31972,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b68f1622981d4733aaf7c22457d781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:19Z,use_quota=True,user_id='fde5bb738d8549a4a77db10fa3cabae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f9114-541f-4785-99d7-3277079c98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483f9114-541f-4785-99d7-3277079c98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8deaa6cd-afe2-4158-998f-0a22c81b8b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8deaa6cd-afe2-4158-998f-0a22c81b8b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b032bdf-e5f8-47b6-818e-ad5e70b31972', 'volume_name': 'volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f652ef-b952-4ab6-a520-9e1df49c0532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f652ef-b952-4ab6-a520-9e1df49c0532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c34cc7-2bcb-46e3-908a-889eeb3e2d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:19 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Volume 1b032bdf-e5f8-47b6-818e-ad5e70b31972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972', 'volume_size': 1} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-192253573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b032bdf-e5f8-47b6-818e-ad5e70b31972,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b68f1622981d4733aaf7c22457d781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:19Z,use_quota=True,user_id='fde5bb738d8549a4a77db10fa3cabae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Creating volume 1b032bdf-e5f8-47b6-818e-ad5e70b31972 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:19 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Volume volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 (9f02b4af-bc95-42f2-9c40-9e42ac138fc7): created successfully Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d5de7b-7de8-4d4a-9ff6-65b12fc4bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Flow 'volume_create_manager' (c434418a-d35a-476e-9285-beeb851c501b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:19 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 1073741824 Apr 21 20:57:19 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-8013651b-2718-4313-9215-967c956fae5d tempest-GroupsTest-2110072902 None] Created volume successfully. Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-5ae76773-0c43-4011-aa45-3b95556e6310" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-5ae76773-0c43-4011-aa45-3b95556e6310" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Deleting offline snapshot 7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c of volume 5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] snapshot_file for this snap is: volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563cc2a-fa53-4c5e-95bf-67f0df994752]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c Apr 21 20:57:20 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 1073741824" returned: 0 in 0.586s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 Apr 21 20:57:20 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" returned: 0 in 0.618s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ae76773-0c43-4011-aa45-3b95556e6310(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f15ea-6f2e-485f-be62-a3754d8e50ac]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972" returned: 0 in 0.489s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c34cc7-2bcb-46e3-908a-889eeb3e2d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec3c007-efa7-4558-9172-70855cf2bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Volume volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 (1b032bdf-e5f8-47b6-818e-ad5e70b31972): created successfully Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec3c007-efa7-4558-9172-70855cf2bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Flow 'volume_create_manager' (cb18d2eb-cc29-4947-9fec-4ff813b03a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:20 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b9cb84a9-e5f2-45a5-84da-cd03f56e467e tempest-VolumesListTestJSON-109064470 None] Created volume successfully. Apr 21 20:57:20 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 Apr 21 20:57:20 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Flow 'volume_create_manager' (b631961b-d0db-45e6-8104-07ba5e6a4b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07d49c4-e26d-4609-bdec-2460b807ead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d07d49c4-e26d-4609-bdec-2460b807ead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701091985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c84d0a60-80b1-4cb6-a52b-fc94f937621f,host='devstack@QuobyteHD#QuobyteHD',id=2c09b733-541f-41d8-b812-735c99fde86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69df25464761486e8d0a60d04406e0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:21Z,use_quota=True,user_id='f9166506930c497287b519c5c35a400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2071bf70-0741-431a-b905-92b315014dbe),volume_type_id=2071bf70-0741-431a-b905-92b315014dbe)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d442ec-489e-4310-b99a-fb8d72981931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d442ec-489e-4310-b99a-fb8d72981931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53da10ca-8886-4215-a33d-ebe2fd408dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53da10ca-8886-4215-a33d-ebe2fd408dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c09b733-541f-41d8-b812-735c99fde86d', 'volume_name': 'volume-2c09b733-541f-41d8-b812-735c99fde86d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d082370f-ef37-41a5-a028-e726be8ad44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d082370f-ef37-41a5-a028-e726be8ad44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e480403-8373-4de1-9b0f-a9fb0a092e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Volume 2c09b733-541f-41d8-b812-735c99fde86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c09b733-541f-41d8-b812-735c99fde86d', 'volume_size': 1} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c84d0a60-80b1-4cb6-a52b-fc94f937621f,created_at=2026-04-21T18:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701091985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c84d0a60-80b1-4cb6-a52b-fc94f937621f,host='devstack@QuobyteHD#QuobyteHD',id=2c09b733-541f-41d8-b812-735c99fde86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69df25464761486e8d0a60d04406e0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:21Z,use_quota=True,user_id='f9166506930c497287b519c5c35a400a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2071bf70-0741-431a-b905-92b315014dbe),volume_type_id=2071bf70-0741-431a-b905-92b315014dbe)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Creating volume 2c09b733-541f-41d8-b812-735c99fde86d {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:20 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d 1073741824 Apr 21 20:57:21 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310" returned: 0 in 0.609s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c Apr 21 20:57:21 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d 1073741824" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d Apr 21 20:57:21 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" returned: 0 in 0.572s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c Apr 21 20:57:21 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Flow 'volume_create_manager' (aafec740-1a6a-4f8f-bbc3-4ebc2eae0aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8171ec-3cac-4675-98a7-800529d223e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8171ec-3cac-4675-98a7-800529d223e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-587190862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae89494-8982-41b7-9206-7c2f2c030c6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b68f1622981d4733aaf7c22457d781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:22Z,use_quota=True,user_id='fde5bb738d8549a4a77db10fa3cabae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7d87ba-23a3-4cb2-8bb9-f285f2bb007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7d87ba-23a3-4cb2-8bb9-f285f2bb007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c070b8cf-c2da-41c7-9658-1acec9e858f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c070b8cf-c2da-41c7-9658-1acec9e858f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae89494-8982-41b7-9206-7c2f2c030c6a', 'volume_name': 'volume-6ae89494-8982-41b7-9206-7c2f2c030c6a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a21474-bca1-4950-821e-e649c924a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a21474-bca1-4950-821e-e649c924a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90a3329-7206-42b1-adfb-a0a338d84a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Volume 6ae89494-8982-41b7-9206-7c2f2c030c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae89494-8982-41b7-9206-7c2f2c030c6a', 'volume_size': 1} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:22 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d" returned: 0 in 0.541s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-587190862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae89494-8982-41b7-9206-7c2f2c030c6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b68f1622981d4733aaf7c22457d781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:22Z,use_quota=True,user_id='fde5bb738d8549a4a77db10fa3cabae3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Creating volume 6ae89494-8982-41b7-9206-7c2f2c030c6a {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:22 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e480403-8373-4de1-9b0f-a9fb0a092e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c09b733-541f-41d8-b812-735c99fde86d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a 1073741824 Apr 21 20:57:22 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc5d4ba-cf92-4a08-8ce8-54c85bbbb476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:22 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Volume volume-2c09b733-541f-41d8-b812-735c99fde86d (2c09b733-541f-41d8-b812-735c99fde86d): created successfully Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc5d4ba-cf92-4a08-8ce8-54c85bbbb476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Flow 'volume_create_manager' (b631961b-d0db-45e6-8104-07ba5e6a4b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:22 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3de0e6d5-45c4-4cc8-806e-5b317d561f5b tempest-GroupsTest-2110072902 None] Created volume successfully. Apr 21 20:57:22 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310.7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" returned: 0 in 0.477s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c" released by "_delete_snapshot" :: held 2.337s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-5ae76773-0c43-4011-aa45-3b95556e6310" released by "delete_snapshot" :: held 2.353s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Created reservations ['670b5745-0334-462c-8daa-0306508fd641', '694efaac-faa6-4119-8e20-61da6b210f8a', '96cb4706-4bb3-4d81-941f-e85eaa4eb56f', '41d9b5f0-5728-42df-9bf8-9a7cfbb98207'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:22 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Delete snapshot completed successfully. Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f878bcce-a5ea-4106-b3fb-0484554d487a tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-7ab294e5-cc9b-40df-a9c6-b2c8f4122c5c-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:22 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a 1073741824" returned: 0 in 0.497s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a Apr 21 20:57:22 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90a3329-7206-42b1-adfb-a0a338d84a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae89494-8982-41b7-9206-7c2f2c030c6a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc49a9a3-fbdf-41ae-92a6-6d61edc1b2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:23 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Volume volume-6ae89494-8982-41b7-9206-7c2f2c030c6a (6ae89494-8982-41b7-9206-7c2f2c030c6a): created successfully Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc49a9a3-fbdf-41ae-92a6-6d61edc1b2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Flow 'volume_create_manager' (aafec740-1a6a-4f8f-bbc3-4ebc2eae0aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-6b6747d4-72b8-4ed7-99ca-ae28c58eaefb tempest-VolumesListTestJSON-109064470 None] Created volume successfully. Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-5ae76773-0c43-4011-aa45-3b95556e6310-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e7d30f5b-77e7-4b12-b0b8-5d7d38f9ea91 tempest-GroupsTest-2110072902 None] Update group completed successfully. Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-5ae76773-0c43-4011-aa45-3b95556e6310-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "cinder-quobyte-5ae76773-0c43-4011-aa45-3b95556e6310" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-5ae76773-0c43-4011-aa45-3b95556e6310" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b426b5-e9cf-4d48-967e-bc4931561fac]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 Apr 21 20:57:23 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310" returned: 0 in 0.530s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310 Apr 21 20:57:23 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-5ae76773-0c43-4011-aa45-3b95556e6310" returned: 0 in 0.514s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-quobyte-5ae76773-0c43-4011-aa45-3b95556e6310" released by "delete_volume" :: held 1.090s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Created reservations ['a489c930-4058-432e-b49d-06094004396a', '99c82bce-cfae-480c-b496-7e36bfee4407', '4b8a82aa-00be-4b56-8267-4aac495d5eec', '9c0f6ccd-d928-4303-a5b8-089cd6c24d70'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack sudo[88491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:24 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-76081ce7-e57d-4d41-99f9-6bb564e9ed96 tempest-GroupsTest-2110072902 None] Update group completed successfully. Apr 21 20:57:24 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.471s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:24 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Deleted volume successfully. Apr 21 20:57:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d144b971-b667-46e1-89c0-4913afae14fd tempest-CreateVolumesFromSnapshotTest-124368197 None] Lock "cinder-5ae76773-0c43-4011-aa45-3b95556e6310-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Acquiring lock "cinder-quobyte-2c09b733-541f-41d8-b812-735c99fde86d" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Lock "cinder-quobyte-2c09b733-541f-41d8-b812-735c99fde86d" acquired by "delete_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:25 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7498ad47-611d-4ad5-b5fa-529915d071e8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d Apr 21 20:57:25 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Acquiring lock "cinder-6ae89494-8982-41b7-9206-7c2f2c030c6a-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Lock "cinder-6ae89494-8982-41b7-9206-7c2f2c030c6a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Acquiring lock "cinder-quobyte-6ae89494-8982-41b7-9206-7c2f2c030c6a" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Lock "cinder-quobyte-6ae89494-8982-41b7-9206-7c2f2c030c6a" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5751677e-4453-48e5-9506-5bda197222d7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a Apr 21 20:57:26 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d" returned: 0 in 0.624s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d Apr 21 20:57:26 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a" returned: 0 in 0.553s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a Apr 21 20:57:26 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2c09b733-541f-41d8-b812-735c99fde86d" returned: 0 in 0.534s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Lock "cinder-quobyte-2c09b733-541f-41d8-b812-735c99fde86d" released by "delete_volume" :: held 1.208s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Acquiring lock "cinder-quobyte-9f02b4af-bc95-42f2-9c40-9e42ac138fc7" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Lock "cinder-quobyte-9f02b4af-bc95-42f2-9c40-9e42ac138fc7" acquired by "delete_volume" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b281e5e-af91-442a-b018-2ea6066a039d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6ae89494-8982-41b7-9206-7c2f2c030c6a" returned: 0 in 0.465s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Lock "cinder-quobyte-6ae89494-8982-41b7-9206-7c2f2c030c6a" released by "delete_volume" :: held 1.056s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:27 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 Apr 21 20:57:27 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Created reservations ['5c6927b7-55eb-44d7-b1ba-274079e2a024', '91a62448-22c0-47eb-8e2a-85a8c0b08099', '891cb952-08f1-40b4-89c0-5999cb83142e', '0e8ae0c6-9e95-4e07-96a5-43438796b8e6'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:27 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (566f5f47-c172-41e4-a800-ed161abcf459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5b5fd3-8da9-4815-bf0b-e3afb283c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5b5fd3-8da9-4815-bf0b-e3afb283c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-194829970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeaac2c-44f1-4b31-b5da-be78f498227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33328d8dc3344fd8a1a906a88127240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:27Z,use_quota=True,user_id='ae92d0e8896241e79f46a16eec28de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d842546-b51f-4ce7-a05f-7a7320fbb667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d842546-b51f-4ce7-a05f-7a7320fbb667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a6441b-9039-4fc1-9d60-93331160cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a6441b-9039-4fc1-9d60-93331160cbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eeaac2c-44f1-4b31-b5da-be78f498227a', 'volume_name': 'volume-0eeaac2c-44f1-4b31-b5da-be78f498227a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ff97c4-404d-4eec-bc27-830b1bb08487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ff97c4-404d-4eec-bc27-830b1bb08487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314362f5-dcb2-4744-abf5-22085899b2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Volume 0eeaac2c-44f1-4b31-b5da-be78f498227a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eeaac2c-44f1-4b31-b5da-be78f498227a', 'volume_size': 1} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-194829970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eeaac2c-44f1-4b31-b5da-be78f498227a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33328d8dc3344fd8a1a906a88127240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:27Z,use_quota=True,user_id='ae92d0e8896241e79f46a16eec28de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Creating volume 0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:27 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a 1073741824 Apr 21 20:57:27 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7" returned: 0 in 0.497s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7 Apr 21 20:57:27 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.504s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:27 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Deleted volume successfully. Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-61fd9ca2-ba3f-411f-8f9c-11e0827dcc6a tempest-VolumesListTestJSON-109064470 None] Lock "cinder-6ae89494-8982-41b7-9206-7c2f2c030c6a-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:27 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a 1073741824" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a Apr 21 20:57:27 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9f02b4af-bc95-42f2-9c40-9e42ac138fc7" returned: 0 in 0.504s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Lock "cinder-quobyte-9f02b4af-bc95-42f2-9c40-9e42ac138fc7" released by "delete_volume" :: held 1.036s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Created reservations ['69d64ebe-c314-473d-8311-b0df3e934e51'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:28 devstack cinder-volume[82362]: WARNING cinder.quota [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1979528783 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1979528783, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:28 devstack cinder-volume[82362]: WARNING cinder.quota [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1979528783 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1979528783, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Created reservations ['2c8302d5-6c03-43b1-afba-16a60c784fda', '41e7b8d2-4917-4659-8e19-b68d58a29af0', '913ce92d-1c87-416e-b952-3553e46f572a', '99230f18-aebd-4490-ae17-5deb31352c5e'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Created reservations ['04faa244-71a8-4833-876e-98b4cb23b32d', 'bf77a334-9b8e-4954-a689-e66a9ec65175', 'd48fc796-2ab6-4a20-acf1-957d4cc137d7', 'cdde096c-d063-4e51-94e3-06d9c91c54e3'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Acquiring lock "cinder-1b032bdf-e5f8-47b6-818e-ad5e70b31972-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Lock "cinder-1b032bdf-e5f8-47b6-818e-ad5e70b31972-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Acquiring lock "cinder-quobyte-1b032bdf-e5f8-47b6-818e-ad5e70b31972" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Lock "cinder-quobyte-1b032bdf-e5f8-47b6-818e-ad5e70b31972" acquired by "delete_volume" :: waited 0.036s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:28 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:28 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb05167-d9cb-464e-a9f0-9c9a12e766cf]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a" returned: 0 in 0.555s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:28 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314362f5-dcb2-4744-abf5-22085899b2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eeaac2c-44f1-4b31-b5da-be78f498227a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8603c5-173c-4924-b828-63edfb05e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:28 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Volume volume-0eeaac2c-44f1-4b31-b5da-be78f498227a (0eeaac2c-44f1-4b31-b5da-be78f498227a): created successfully Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8603c5-173c-4924-b828-63edfb05e50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (566f5f47-c172-41e4-a800-ed161abcf459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4c7be5c1-a1ba-437f-83c1-ff36dd070736 tempest-VolumeDependencyTests-252080985 None] Created volume successfully. Apr 21 20:57:28 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.483s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d4d5171a-5ac9-4fb6-b15e-f1d2adcaf197 tempest-GroupsTest-2110072902 None] Delete group completed successfully. Apr 21 20:57:28 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972" returned: 0 in 0.540s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972 Apr 21 20:57:29 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1b032bdf-e5f8-47b6-818e-ad5e70b31972" returned: 0 in 0.529s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Lock "cinder-quobyte-1b032bdf-e5f8-47b6-818e-ad5e70b31972" released by "delete_volume" :: held 1.095s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Created reservations ['774c3954-1d4b-4bdf-9041-2acdcecdd1d9', '797a564c-b8d3-4abd-8668-14fa427e2b64', 'b805763f-1415-488b-9a8e-36c8834a7459', 'fd8b44b7-9cbd-43dd-88f9-931cc15b976d'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:29 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Creating offline snapshot ea29d7a8-1008-40bb-9a06-4b837ab78947 of volume 0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37054b5-681f-4013-a04c-407760c88e92]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a Apr 21 20:57:29 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.553s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:30 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Deleted volume successfully. Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9bfedca2-b73f-4268-a0f5-825a5dd3219d tempest-VolumesListTestJSON-109064470 None] Lock "cinder-1b032bdf-e5f8-47b6-818e-ad5e70b31972-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:30 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a" returned: 0 in 0.625s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 1G Apr 21 20:57:30 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Acquiring lock "cinder-deaea446-c5c1-472b-87ec-bb027365644d-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Lock "cinder-deaea446-c5c1-472b-87ec-bb027365644d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Acquiring lock "cinder-quobyte-deaea446-c5c1-472b-87ec-bb027365644d" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Lock "cinder-quobyte-deaea446-c5c1-472b-87ec-bb027365644d" acquired by "delete_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a5e4bb-a992-4c3b-b750-abd5515c95f2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d Apr 21 20:57:30 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 1G" returned: 0 in 0.660s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eeaac2c-44f1-4b31-b5da-be78f498227a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eeaac2c-44f1-4b31-b5da-be78f498227a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 Apr 21 20:57:31 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d" returned: 0 in 0.587s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d Apr 21 20:57:31 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0eeaac2c-44f1-4b31-b5da-be78f498227a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947" returned: 0 in 0.603s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:31 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 is being set with open permissions: ugo+rw Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 Apr 21 20:57:31 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-deaea446-c5c1-472b-87ec-bb027365644d" returned: 0 in 0.533s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Lock "cinder-quobyte-deaea446-c5c1-472b-87ec-bb027365644d" released by "delete_volume" :: held 1.149s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Created reservations ['29553cdd-5520-4e81-abb2-9f8e7cf5f898', 'fb950e20-4d8c-4d90-a366-e30606744b5b', '9fb4746a-acf5-413e-9cbb-a4d7e480c2dd', '8ea92070-780a-4dc2-9055-1c8f67037c82'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:31 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:31 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947" returned: 0 in 0.531s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.info Apr 21 20:57:32 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.515s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:32 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Deleted volume successfully. Apr 21 20:57:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-51210576-cb15-4d36-a912-802f411b6237 tempest-VolumesListTestJSON-109064470 None] Lock "cinder-deaea446-c5c1-472b-87ec-bb027365644d-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:32 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.info" returned: 0 in 0.480s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.info is being set with open permissions: ugo+rw Apr 21 20:57:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.info Apr 21 20:57:32 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.info" returned: 0 in 0.468s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.427s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:33 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d85e3e11-5e7b-4183-b9af-cb7fbb449e21 tempest-VolumeDependencyTests-252080985 None] Create snapshot completed successfully Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Flow 'volume_create_manager' (2107879c-f476-47c3-86c6-b4a249ed6030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb778ce-a79e-4543-934d-4a2b1b2c6f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb778ce-a79e-4543-934d-4a2b1b2c6f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-67955354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a34d44-eba3-446b-9c6d-77cecb149c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1d231778dd4eaaa8459475b1a60c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:33Z,use_quota=True,user_id='ef1995c7320c4a9ebe26024569584d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae03617-a3f6-4638-b53a-fe958e7e798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae03617-a3f6-4638-b53a-fe958e7e798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad78e4f-ae11-4890-95d3-80df10e74067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad78e4f-ae11-4890-95d3-80df10e74067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a34d44-eba3-446b-9c6d-77cecb149c9a', 'volume_name': 'volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fab58e-2af1-4554-be98-4cb8d717f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fab58e-2af1-4554-be98-4cb8d717f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4abe845-2f29-4d27-922a-d045af5a2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:33 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Volume a0a34d44-eba3-446b-9c6d-77cecb149c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a', 'volume_size': 1} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-67955354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a34d44-eba3-446b-9c6d-77cecb149c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1d231778dd4eaaa8459475b1a60c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:33Z,use_quota=True,user_id='ef1995c7320c4a9ebe26024569584d62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Creating volume a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:33 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a 1073741824 Apr 21 20:57:33 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (7cf30f70-dd29-4ca2-85b0-6d82a8b232af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c769b2a0-fb5a-4bea-92db-5ab84bf60ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c769b2a0-fb5a-4bea-92db-5ab84bf60ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-862661846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf02ce44-c8aa-47b1-8516-c6adb94152bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33328d8dc3344fd8a1a906a88127240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea29d7a8-1008-40bb-9a06-4b837ab78947,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:34Z,use_quota=True,user_id='ae92d0e8896241e79f46a16eec28de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77b455c-f0cb-4ec4-8c0a-67487d3b2c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77b455c-f0cb-4ec4-8c0a-67487d3b2c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578970d7-4d66-46cd-aa26-f888152f2162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578970d7-4d66-46cd-aa26-f888152f2162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf02ce44-c8aa-47b1-8516-c6adb94152bb', 'volume_name': 'volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb', 'volume_size': 1, 'snapshot_id': 'ea29d7a8-1008-40bb-9a06-4b837ab78947'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b658921-1aae-4c69-b412-f8f6afaeed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b658921-1aae-4c69-b412-f8f6afaeed0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e1f83c-c8f4-48af-95ca-f55531431a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Volume bf02ce44-c8aa-47b1-8516-c6adb94152bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb', 'volume_size': 1, 'snapshot_id': 'ea29d7a8-1008-40bb-9a06-4b837ab78947'} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:34 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a 1073741824" returned: 0 in 0.675s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a Apr 21 20:57:34 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a" returned: 0 in 0.483s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.527s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-ea29d7a8-1008-40bb-9a06-4b837ab78947-bf02ce44-c8aa-47b1-8516-c6adb94152bb" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-ea29d7a8-1008-40bb-9a06-4b837ab78947-bf02ce44-c8aa-47b1-8516-c6adb94152bb" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Creating volume bf02ce44-c8aa-47b1-8516-c6adb94152bb from snapshot ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-bf02ce44-c8aa-47b1-8516-c6adb94152bb" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4abe845-2f29-4d27-922a-d045af5a2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0479a4-585b-4dcd-9af1-5d8879eb6806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:34 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Volume volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a (a0a34d44-eba3-446b-9c6d-77cecb149c9a): created successfully Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0479a4-585b-4dcd-9af1-5d8879eb6806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Flow 'volume_create_manager' (2107879c-f476-47c3-86c6-b4a249ed6030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-bf02ce44-c8aa-47b1-8516-c6adb94152bb" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] snapshot: ea29d7a8-1008-40bb-9a06-4b837ab78947, volume: bf02ce44-c8aa-47b1-8516-c6adb94152bb, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:34 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-10752c76-7cf4-430e-bdea-d04f7474b453 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Created volume successfully. Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dd5ce4-64e0-4a6c-8cf5-8f88de2abfb7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 Apr 21 20:57:34 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947" returned: 0 in 0.588s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eeaac2c-44f1-4b31-b5da-be78f498227a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:57:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:57:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b24d394-f188-410e-ae00-89819faaf66f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a Apr 21 20:57:35 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:36 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a" returned: 0 in 0.569s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb Apr 21 20:57:36 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:38 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb" returned: 0 in 2.286s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:38 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a181e8-0303-45de-a0b4-b7664a38dcc0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:38 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a Apr 21 20:57:38 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:38 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a" returned: 0 in 0.598s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:38 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:38 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Converted 1024.00 MB image at 447.51 MB/s Apr 21 20:57:38 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb is being set with open permissions: ugo+rw Apr 21 20:57:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:38 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb Apr 21 20:57:38 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb" returned: 0 in 0.557s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-bf02ce44-c8aa-47b1-8516-c6adb94152bb" released by "_copy_volume_from_snapshot" :: held 4.677s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-ea29d7a8-1008-40bb-9a06-4b837ab78947-bf02ce44-c8aa-47b1-8516-c6adb94152bb" released by "_create_volume_from_snapshot" :: held 4.725s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.741s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.746s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Creating offline snapshot 3f141abc-83d3-4c27-a793-539261fe7ae8 of volume a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e1f83c-c8f4-48af-95ca-f55531431a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb', 'volume_size': 1, 'snapshot_id': 'ea29d7a8-1008-40bb-9a06-4b837ab78947'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d594bc-6ef2-45b6-8209-09d2a9e66fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5595fd86-df84-4da1-941c-142572dfdd38]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Volume volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb (bf02ce44-c8aa-47b1-8516-c6adb94152bb): created successfully Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d594bc-6ef2-45b6-8209-09d2a9e66fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (7cf30f70-dd29-4ca2-85b0-6d82a8b232af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-8c2b5298-213e-447b-b066-5e3b67d621c2 tempest-VolumeDependencyTests-252080985 None] Created volume successfully. Apr 21 20:57:39 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a Apr 21 20:57:39 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a" returned: 0 in 0.568s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 1G Apr 21 20:57:40 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-ea29d7a8-1008-40bb-9a06-4b837ab78947-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-ea29d7a8-1008-40bb-9a06-4b837ab78947-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-0eeaac2c-44f1-4b31-b5da-be78f498227a" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-0eeaac2c-44f1-4b31-b5da-be78f498227a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-ea29d7a8-1008-40bb-9a06-4b837ab78947" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-ea29d7a8-1008-40bb-9a06-4b837ab78947" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Deleting offline snapshot ea29d7a8-1008-40bb-9a06-4b837ab78947 of volume 0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] snapshot_file for this snap is: volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5fbe95-9595-4056-84e1-904d17bcb41a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 Apr 21 20:57:40 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 1G" returned: 0 in 0.707s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 Apr 21 20:57:40 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947" returned: 0 in 0.645s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0eeaac2c-44f1-4b31-b5da-be78f498227a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eb47d3-07c5-4be5-9818-692feb00ed2b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a Apr 21 20:57:41 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8" returned: 0 in 0.576s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 is being set with open permissions: ugo+rw Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 Apr 21 20:57:41 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a" returned: 0 in 0.581s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 Apr 21 20:57:41 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8" returned: 0 in 0.576s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.info Apr 21 20:57:42 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947" returned: 0 in 0.522s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947 Apr 21 20:57:42 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.info" returned: 0 in 0.575s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.info is being set with open permissions: ugo+rw Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.info Apr 21 20:57:42 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a.ea29d7a8-1008-40bb-9a06-4b837ab78947" returned: 0 in 0.562s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-ea29d7a8-1008-40bb-9a06-4b837ab78947" released by "_delete_snapshot" :: held 2.377s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-0eeaac2c-44f1-4b31-b5da-be78f498227a" released by "delete_snapshot" :: held 2.397s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Created reservations ['78857363-5114-4127-93b2-10e30bb0a639', 'f6412db7-d079-47a1-8f4d-386aeb8046dc', '13f7ef15-f2b9-42b5-a80b-db5ec705d425', 'da07f61e-89c2-4548-bdde-6919b1a59f2c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:43 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Delete snapshot completed successfully. Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1e18eab-56f9-4727-88c1-d60cf816437d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-ea29d7a8-1008-40bb-9a06-4b837ab78947-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:43 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.info" returned: 0 in 0.540s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.635s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:43 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5bbaf681-7e53-4352-9346-0846211b6021 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Create snapshot completed successfully Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (2a3fd39e-01f1-4470-8542-ef55cb061bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54293dbf-423a-4a2d-9191-551b4106282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54293dbf-423a-4a2d-9191-551b4106282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1024525840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693703b0-7656-49e7-b9ba-3c45f061fe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:43Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df3d4e-4998-44e4-824d-24019656a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df3d4e-4998-44e4-824d-24019656a848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c929b99-b158-4fa9-931f-b820a2ce00f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c929b99-b158-4fa9-931f-b820a2ce00f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693703b0-7656-49e7-b9ba-3c45f061fe75', 'volume_name': 'volume-693703b0-7656-49e7-b9ba-3c45f061fe75', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd41e03-f530-473a-b8cf-8902d40d1dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd41e03-f530-473a-b8cf-8902d40d1dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96434d8-80df-4ac2-8cd4-b75d6fac0c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:43 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Volume 693703b0-7656-49e7-b9ba-3c45f061fe75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693703b0-7656-49e7-b9ba-3c45f061fe75', 'volume_size': 1} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1024525840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693703b0-7656-49e7-b9ba-3c45f061fe75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:43Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Creating volume 693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:43 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 1073741824 Apr 21 20:57:43 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-0eeaac2c-44f1-4b31-b5da-be78f498227a-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-0eeaac2c-44f1-4b31-b5da-be78f498227a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-0eeaac2c-44f1-4b31-b5da-be78f498227a" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-0eeaac2c-44f1-4b31-b5da-be78f498227a" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c16f583-f558-4aa1-be46-be018c78d1de]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:43 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a Apr 21 20:57:43 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 1073741824" returned: 0 in 0.571s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 Apr 21 20:57:44 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a" returned: 0 in 0.533s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a Apr 21 20:57:44 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "cinder-3f141abc-83d3-4c27-a793-539261fe7ae8-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-3f141abc-83d3-4c27-a793-539261fe7ae8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "cinder-quobyte-a0a34d44-eba3-446b-9c6d-77cecb149c9a" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-quobyte-a0a34d44-eba3-446b-9c6d-77cecb149c9a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "cinder-quobyte-3f141abc-83d3-4c27-a793-539261fe7ae8" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-quobyte-3f141abc-83d3-4c27-a793-539261fe7ae8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Deleting offline snapshot 3f141abc-83d3-4c27-a793-539261fe7ae8 of volume a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] snapshot_file for this snap is: volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a243c4c-329f-41c6-9a25-64d704fa108f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75" returned: 0 in 0.458s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:44 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 Apr 21 20:57:44 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96434d8-80df-4ac2-8cd4-b75d6fac0c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693703b0-7656-49e7-b9ba-3c45f061fe75', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2316df57-f863-4f05-b000-d4bf4c4c4f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Volume volume-693703b0-7656-49e7-b9ba-3c45f061fe75 (693703b0-7656-49e7-b9ba-3c45f061fe75): created successfully Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2316df57-f863-4f05-b000-d4bf4c4c4f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (2a3fd39e-01f1-4470-8542-ef55cb061bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-aaa72ffc-b47b-4fd1-be38-ceae2f73a752 tempest-VolumesSnapshotTestJSON-666154326 None] Created volume successfully. Apr 21 20:57:44 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0eeaac2c-44f1-4b31-b5da-be78f498227a" returned: 0 in 0.494s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-0eeaac2c-44f1-4b31-b5da-be78f498227a" released by "delete_volume" :: held 1.063s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Created reservations ['d1f16416-dff6-473b-971a-5b0031020ad0', 'a690f372-abb7-4166-8a4c-a7bf0ae61c8e', '6c491724-a1a4-4c67-94ae-bb68cbc44286', '51293202-61a3-455d-bb69-d59ef87ed364'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:44 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8" returned: 0 in 0.475s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d4489-f41b-44cf-925e-9a76d8799ede]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a Apr 21 20:57:45 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.458s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Deleted volume successfully. Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc472ea9-4bca-404b-8b39-1e52d9702c24 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-0eeaac2c-44f1-4b31-b5da-be78f498227a-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:45 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 Apr 21 20:57:45 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Creating offline snapshot 16d6dd78-e39f-4903-8275-73533f7244cf of volume 693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a2e1ac-7277-4247-b95f-61512d69e1a6]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 Apr 21 20:57:45 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8" returned: 0 in 0.542s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8 Apr 21 20:57:46 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (4ea9323d-16a0-4f53-972b-2eb7b91ee4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d39d6e-ef4d-45fa-b518-e85312b3ccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d39d6e-ef4d-45fa-b518-e85312b3ccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1969783859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4120073-cdeb-4deb-ba7f-1df125b0b21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33328d8dc3344fd8a1a906a88127240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:46Z,use_quota=True,user_id='ae92d0e8896241e79f46a16eec28de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365bda60-4ea4-44d4-a55e-32e79139f04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365bda60-4ea4-44d4-a55e-32e79139f04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe3255e-ac27-4b6e-8c80-3c63316486be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe3255e-ac27-4b6e-8c80-3c63316486be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4120073-cdeb-4deb-ba7f-1df125b0b21f', 'volume_name': 'volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed400e1d-36e5-4531-a950-9479f54d9e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed400e1d-36e5-4531-a950-9479f54d9e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754ec6ac-3caa-4d4e-afcf-61aba1be193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Volume b4120073-cdeb-4deb-ba7f-1df125b0b21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f', 'volume_size': 1} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:46 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75" returned: 0 in 0.595s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf 1G Apr 21 20:57:46 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a.3f141abc-83d3-4c27-a793-539261fe7ae8" returned: 0 in 0.407s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-quobyte-3f141abc-83d3-4c27-a793-539261fe7ae8" released by "_delete_snapshot" :: held 2.021s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-quobyte-a0a34d44-eba3-446b-9c6d-77cecb149c9a" released by "delete_snapshot" :: held 2.046s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Created reservations ['782f79dc-667e-4a95-aa13-0c6db247dae1', '7fe7fe46-ab8c-491e-a650-fb3ead6e4953', '81757803-a880-4271-8f7b-aaa642e45384', 'bbb742f6-a869-4a87-8b05-9d92d83357ca'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:46 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Delete snapshot completed successfully. Apr 21 20:57:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-357c6ec4-5a5e-470a-9a6d-3dcb968af505 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-3f141abc-83d3-4c27-a793-539261fe7ae8-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:47 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf 1G" returned: 0 in 0.526s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693703b0-7656-49e7-b9ba-3c45f061fe75 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693703b0-7656-49e7-b9ba-3c45f061fe75 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf Apr 21 20:57:47 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-693703b0-7656-49e7-b9ba-3c45f061fe75 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf" returned: 0 in 0.508s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf is being set with open permissions: ugo+rw Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf Apr 21 20:57:47 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "cinder-a0a34d44-eba3-446b-9c6d-77cecb149c9a-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-a0a34d44-eba3-446b-9c6d-77cecb149c9a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "cinder-quobyte-a0a34d44-eba3-446b-9c6d-77cecb149c9a" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-quobyte-a0a34d44-eba3-446b-9c6d-77cecb149c9a" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04603b8-7b4b-4c0f-8674-1c5f282d18b1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a Apr 21 20:57:47 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf" returned: 0 in 0.435s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.info Apr 21 20:57:48 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a" returned: 0 in 0.564s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a Apr 21 20:57:48 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.info" returned: 0 in 0.440s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.info is being set with open permissions: ugo+rw Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.info Apr 21 20:57:48 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a0a34d44-eba3-446b-9c6d-77cecb149c9a" returned: 0 in 0.420s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-quobyte-a0a34d44-eba3-446b-9c6d-77cecb149c9a" released by "delete_volume" :: held 1.020s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Created reservations ['aac0fa93-755e-46d4-889c-259a71d15203', 'd4181961-97f2-4c23-a0f0-71e267c5b2d5', 'd57d0ca9-14dc-4f82-9817-485c492e8be5', 'c1e3c00f-bcf7-48ae-8d3d-fc6d61528c07'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:48 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.info" returned: 0 in 0.486s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.064s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:48 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:57:48 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.681s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1969783859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4120073-cdeb-4deb-ba7f-1df125b0b21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33328d8dc3344fd8a1a906a88127240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:46Z,use_quota=True,user_id='ae92d0e8896241e79f46a16eec28de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Creating volume b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:48 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:57:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f 1073741824 Apr 21 20:57:48 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d9d83ae4-a277-4407-ae61-5942d9d5ae26 tempest-VolumesSnapshotTestJSON-666154326 None] Create snapshot completed successfully Apr 21 20:57:49 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.522s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Deleted volume successfully. Apr 21 20:57:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-11103b96-4323-4212-b32d-00b774c25ef0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1224714429 None] Lock "cinder-a0a34d44-eba3-446b-9c6d-77cecb149c9a-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:49 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f 1073741824" returned: 0 in 0.553s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:49 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f Apr 21 20:57:49 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f" returned: 0 in 0.538s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754ec6ac-3caa-4d4e-afcf-61aba1be193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef4943e-e104-422f-9d6a-fbd4f823a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:50 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Volume volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f (b4120073-cdeb-4deb-ba7f-1df125b0b21f): created successfully Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ef4943e-e104-422f-9d6a-fbd4f823a859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (4ea9323d-16a0-4f53-972b-2eb7b91ee4d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:50 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c97cd705-a95d-46e9-877f-4b29738db57a tempest-VolumeDependencyTests-252080985 None] Created volume successfully. Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-16d6dd78-e39f-4903-8275-73533f7244cf-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-16d6dd78-e39f-4903-8275-73533f7244cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-693703b0-7656-49e7-b9ba-3c45f061fe75" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-693703b0-7656-49e7-b9ba-3c45f061fe75" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-16d6dd78-e39f-4903-8275-73533f7244cf" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-16d6dd78-e39f-4903-8275-73533f7244cf" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Deleting offline snapshot 16d6dd78-e39f-4903-8275-73533f7244cf of volume 693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] snapshot_file for this snap is: volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fee865a-b30f-433f-a069-3bd390e54ab5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:50 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf Apr 21 20:57:50 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (03461ed4-dc1f-4327-90f4-31471b20290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a079b1be-4ba6-4b1b-833f-f7c33c78c380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a079b1be-4ba6-4b1b-833f-f7c33c78c380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1616539168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91539ea5-26b4-43a7-bffc-7ccee8df6f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33328d8dc3344fd8a1a906a88127240b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b4120073-cdeb-4deb-ba7f-1df125b0b21f,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:51Z,use_quota=True,user_id='ae92d0e8896241e79f46a16eec28de0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdc1d30-d55a-4f4c-bdc5-1bd08ab37730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdc1d30-d55a-4f4c-bdc5-1bd08ab37730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2002c3-f40a-46c5-9e32-29612ab74553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2002c3-f40a-46c5-9e32-29612ab74553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '91539ea5-26b4-43a7-bffc-7ccee8df6f12', 'volume_name': 'volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12', 'volume_size': 1, 'source_volid': 'b4120073-cdeb-4deb-ba7f-1df125b0b21f', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9db27d-6e9c-49a3-849b-577b5fdc5147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9db27d-6e9c-49a3-849b-577b5fdc5147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf358cb-b709-41a4-86a2-0db48592a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:50 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Volume 91539ea5-26b4-43a7-bffc-7ccee8df6f12: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12', 'volume_size': 1, 'source_volid': 'b4120073-cdeb-4deb-ba7f-1df125b0b21f', 'source_volstatus': 'available'} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:50 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Cloning volume b4120073-cdeb-4deb-ba7f-1df125b0b21f to volume 91539ea5-26b4-43a7-bffc-7ccee8df6f12 Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Creating offline snapshot d8a2338b-6b44-4eac-9b41-6f27c267ff01 of volume b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ab441-5bc4-4832-919c-95a3e4b74f72]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:50 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf" returned: 0 in 0.684s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-693703b0-7656-49e7-b9ba-3c45f061fe75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:50 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f Apr 21 20:57:50 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[195cc0a3-a2ea-4b99-a696-426f9155d293]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 Apr 21 20:57:51 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f" returned: 0 in 0.603s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 1G Apr 21 20:57:51 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75" returned: 0 in 0.675s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf Apr 21 20:57:51 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 1G" returned: 0 in 0.603s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 Apr 21 20:57:52 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf" returned: 0 in 0.605s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf Apr 21 20:57:52 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01" returned: 0 in 0.507s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 is being set with open permissions: ugo+rw Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 Apr 21 20:57:52 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75.16d6dd78-e39f-4903-8275-73533f7244cf" returned: 0 in 0.442s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-16d6dd78-e39f-4903-8275-73533f7244cf" released by "_delete_snapshot" :: held 2.495s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-693703b0-7656-49e7-b9ba-3c45f061fe75" released by "delete_snapshot" :: held 2.512s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['6f9de614-890f-4643-8559-64214288512c', '5fc51341-b034-4dd5-89a2-a4f9730525ee', '9f711744-8b12-45bc-b73a-66634ff8acf0', '2033389d-430e-4afe-93dd-70f3455d35b9'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Delete snapshot completed successfully. Apr 21 20:57:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd72d6c5-8a90-407a-9026-965fd4d337d9 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-16d6dd78-e39f-4903-8275-73533f7244cf-delete_snapshot" released by "delete_snapshot" :: held 2.655s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:53 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01" returned: 0 in 0.530s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.info Apr 21 20:57:53 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (f060dffb-0301-4b7c-8fce-d8ac8242297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc76552-8311-4a9e-9e15-5d2345f2a35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:53 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.info" returned: 0 in 0.626s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.info is being set with open permissions: ugo+rw Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc76552-8311-4a9e-9e15-5d2345f2a35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2089542979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ba8628-38e5-4329-bcb1-0ee592370e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:54Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.info Apr 21 20:57:53 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03000a23-58ad-4c93-87ec-3bfc94bf3710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03000a23-58ad-4c93-87ec-3bfc94bf3710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783e3f48-84d7-44fc-9a39-54c9f153313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783e3f48-84d7-44fc-9a39-54c9f153313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ba8628-38e5-4329-bcb1-0ee592370e08', 'volume_name': 'volume-c6ba8628-38e5-4329-bcb1-0ee592370e08', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12be2e33-d87c-486c-a59b-a9733b03614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12be2e33-d87c-486c-a59b-a9733b03614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e318d7ec-64e9-4b28-b67a-31f0e85babbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:53 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Volume c6ba8628-38e5-4329-bcb1-0ee592370e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ba8628-38e5-4329-bcb1-0ee592370e08', 'volume_size': 1} Apr 21 20:57:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:54 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.info" returned: 0 in 0.466s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-91539ea5-26b4-43a7-bffc-7ccee8df6f12" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-91539ea5-26b4-43a7-bffc-7ccee8df6f12" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] snapshot: d8a2338b-6b44-4eac-9b41-6f27c267ff01, volume: 91539ea5-26b4-43a7-bffc-7ccee8df6f12, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7489c-d0e6-4f4b-b2b9-79dcedc736e1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 Apr 21 20:57:54 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01" returned: 0 in 0.587s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a238acc-041c-4cc7-ab63-597fd7738fc7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f Apr 21 20:57:54 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f" returned: 0 in 0.584s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 Apr 21 20:57:55 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12" returned: 0 in 2.523s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[add823bc-2fa9-4882-99be-7e01208b7672]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f Apr 21 20:57:58 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f" returned: 0 in 0.632s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:58 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Converted 1024.00 MB image at 405.58 MB/s Apr 21 20:57:58 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 is being set with open permissions: ugo+rw Apr 21 20:57:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 Apr 21 20:57:58 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12" returned: 0 in 0.462s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-91539ea5-26b4-43a7-bffc-7ccee8df6f12" released by "_copy_volume_from_snapshot" :: held 4.844s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=201,cinder:UPDATE=229,cinder:INSERT=65,cinder:DELETE=18 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-d8a2338b-6b44-4eac-9b41-6f27c267ff01" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-d8a2338b-6b44-4eac-9b41-6f27c267ff01" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Deleting offline snapshot d8a2338b-6b44-4eac-9b41-6f27c267ff01 of volume b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] snapshot_file for this snap is: volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[af50df50-6c02-430e-861c-85c4118ad216]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 Apr 21 20:57:59 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01" returned: 0 in 0.597s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa5338e-5395-437b-b102-0a99f5ef56c4]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f Apr 21 20:57:59 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f" returned: 0 in 0.593s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 Apr 21 20:58:00 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01" returned: 0 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01 Apr 21 20:58:00 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f.d8a2338b-6b44-4eac-9b41-6f27c267ff01" returned: 0 in 0.509s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-d8a2338b-6b44-4eac-9b41-6f27c267ff01" released by "_delete_snapshot" :: held 2.308s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=211,cinder:UPDATE=256,cinder:INSERT=62,cinder:DELETE=19 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.629s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.640s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2089542979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ba8628-38e5-4329-bcb1-0ee592370e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:54Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Creating volume c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:01 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf358cb-b709-41a4-86a2-0db48592a0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12', 'volume_size': 1, 'source_volid': 'b4120073-cdeb-4deb-ba7f-1df125b0b21f', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3495dd7-5e97-4563-9d35-634716343565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:01 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 1073741824 Apr 21 20:58:01 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Volume volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 (91539ea5-26b4-43a7-bffc-7ccee8df6f12): created successfully Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3495dd7-5e97-4563-9d35-634716343565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Flow 'volume_create_manager' (03461ed4-dc1f-4327-90f4-31471b20290a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-aa219242-63c1-438b-a398-15b201ae84e5 tempest-VolumeDependencyTests-252080985 None] Created volume successfully. Apr 21 20:58:02 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 1073741824" returned: 0 in 0.551s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 Apr 21 20:58:02 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-b4120073-cdeb-4deb-ba7f-1df125b0b21f-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-b4120073-cdeb-4deb-ba7f-1df125b0b21f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-b4120073-cdeb-4deb-ba7f-1df125b0b21f" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-b4120073-cdeb-4deb-ba7f-1df125b0b21f" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c12591-20df-4d83-b9c1-4c37bb4dd722]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[88845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:02 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f Apr 21 20:58:02 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08" returned: 0 in 0.558s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e318d7ec-64e9-4b28-b67a-31f0e85babbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ba8628-38e5-4329-bcb1-0ee592370e08', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68650f0a-b063-4dc7-bdf4-04c115482244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:02 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Volume volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 (c6ba8628-38e5-4329-bcb1-0ee592370e08): created successfully Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68650f0a-b063-4dc7-bdf4-04c115482244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (f060dffb-0301-4b7c-8fce-d8ac8242297d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c1ee42b2-2f19-45b3-a0cf-b455402a9b22 tempest-VolumesSnapshotTestJSON-666154326 None] Created volume successfully. Apr 21 20:58:03 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.551s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:03 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f" returned: 0 in 0.715s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f Apr 21 20:58:03 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Creating offline snapshot 88c986d1-a4dc-439b-b25a-827192db7f61 of volume c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[45819335-7328-489b-8384-f91484f6794b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 Apr 21 20:58:03 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b4120073-cdeb-4deb-ba7f-1df125b0b21f" returned: 0 in 0.529s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-b4120073-cdeb-4deb-ba7f-1df125b0b21f" released by "delete_volume" :: held 1.294s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Created reservations ['a31b45aa-e3b9-4dbb-83d6-b455299fed0c', '0e0d22bd-cc35-49c0-8bc4-d01b82e7ab80', '6f31a9d9-07f8-4cd3-80a0-b0a486a3d4c6', 'ed405951-bbd8-4e32-bff4-944d614d1b30'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:03 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08" returned: 0 in 0.525s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 1G Apr 21 20:58:03 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.515s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:04 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Deleted volume successfully. Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-edbe2a47-9b32-40c1-b05a-0623338fb65d tempest-VolumeDependencyTests-252080985 None] Lock "cinder-b4120073-cdeb-4deb-ba7f-1df125b0b21f-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:04 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 1G" returned: 0 in 0.500s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 Apr 21 20:58:04 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-91539ea5-26b4-43a7-bffc-7ccee8df6f12-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-91539ea5-26b4-43a7-bffc-7ccee8df6f12-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-91539ea5-26b4-43a7-bffc-7ccee8df6f12" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-91539ea5-26b4-43a7-bffc-7ccee8df6f12" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3416f7a1-ed97-43b3-bff9-36b819b8497e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 Apr 21 20:58:04 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61" returned: 0 in 0.493s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 is being set with open permissions: ugo+rw Apr 21 20:58:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 Apr 21 20:58:04 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12" returned: 0 in 0.627s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12 Apr 21 20:58:05 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61" returned: 0 in 0.502s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.info Apr 21 20:58:05 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-91539ea5-26b4-43a7-bffc-7ccee8df6f12" returned: 0 in 0.511s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-91539ea5-26b4-43a7-bffc-7ccee8df6f12" released by "delete_volume" :: held 1.174s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Created reservations ['bcb51689-456c-4b1e-b98d-f2d2732bcad6', '85825322-6d28-4f63-970e-ab89fde30971', 'a3865fc2-3b09-4360-b680-75373643516b', 'b6d0bf7a-d88d-46a0-8808-9833b11d0c60'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:05 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.info" returned: 0 in 0.517s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.info is being set with open permissions: ugo+rw Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.info Apr 21 20:58:06 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.info" returned: 0 in 0.450s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.064s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:06 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.540s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-eb1e7b3f-7d57-4bdd-af39-f450875b16cf tempest-VolumesSnapshotTestJSON-666154326 None] Create snapshot completed successfully Apr 21 20:58:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Deleted volume successfully. Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-88377661-d0b3-449b-b5d5-807095e44254 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-91539ea5-26b4-43a7-bffc-7ccee8df6f12-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-bf02ce44-c8aa-47b1-8516-c6adb94152bb-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-bf02ce44-c8aa-47b1-8516-c6adb94152bb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "cinder-quobyte-bf02ce44-c8aa-47b1-8516-c6adb94152bb" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-bf02ce44-c8aa-47b1-8516-c6adb94152bb" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc919a1b-693e-46f8-b92c-a97e9ef2b430]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:07 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb Apr 21 20:58:07 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:07 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb" returned: 0 in 0.651s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:07 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb Apr 21 20:58:07 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:07 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (6223a2cf-8739-407a-b29e-067298dde5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27851b5f-24b4-4105-ac28-ff9513a91bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27851b5f-24b4-4105-ac28-ff9513a91bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-260791842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=88c986d1-a4dc-439b-b25a-827192db7f61,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:08Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204deb0f-0719-4b88-866c-b01923742317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204deb0f-0719-4b88-866c-b01923742317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12818fdd-4218-48eb-98fc-e571cbadb040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12818fdd-4218-48eb-98fc-e571cbadb040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8', 'volume_name': 'volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8', 'volume_size': 2, 'snapshot_id': '88c986d1-a4dc-439b-b25a-827192db7f61'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc87846a-6ecb-44f3-b3f4-58a2d310e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc87846a-6ecb-44f3-b3f4-58a2d310e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6cd2d5-d25a-462b-abd1-a67f079852b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:08 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Volume 7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8', 'volume_size': 2, 'snapshot_id': '88c986d1-a4dc-439b-b25a-827192db7f61'} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-88c986d1-a4dc-439b-b25a-827192db7f61-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-88c986d1-a4dc-439b-b25a-827192db7f61-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Creating volume 7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 from snapshot 88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] snapshot: 88c986d1-a4dc-439b-b25a-827192db7f61, volume: 7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d4d13-d9a8-4a8a-adcc-3a24dc448191]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 Apr 21 20:58:08 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-bf02ce44-c8aa-47b1-8516-c6adb94152bb" returned: 0 in 0.659s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-quobyte-bf02ce44-c8aa-47b1-8516-c6adb94152bb" released by "delete_volume" :: held 1.351s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Created reservations ['55e25b73-52aa-4434-9a86-f1bb64792791', '2452d751-995d-46dc-aa77-b487078f8d33', '2c8c6e22-d975-46fc-9562-210a5d6d0cb8', '334fe622-90e0-4a97-ab7d-9b20d81452ac'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:08 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61" returned: 0 in 0.694s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ba8628-38e5-4329-bcb1-0ee592370e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c9e7c4-99d2-4d31-936e-2e0c24898362]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 Apr 21 20:58:09 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.659s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:09 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Deleted volume successfully. Apr 21 20:58:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-182e83ce-4964-4d45-9403-7c6601db6cc3 tempest-VolumeDependencyTests-252080985 None] Lock "cinder-bf02ce44-c8aa-47b1-8516-c6adb94152bb-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:09 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08" returned: 0 in 0.698s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:58:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 Apr 21 20:58:09 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:12 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" returned: 0 in 2.640s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a72ec-c2e8-45c6-90f2-15ba7e5dcbb2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 Apr 21 20:58:12 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:13 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08" returned: 0 in 0.751s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08, size 1024.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:13 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Converted 1024.00 MB image at 387.64 MB/s Apr 21 20:58:13 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 is being set with open permissions: ugo+rw Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:13 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 Apr 21 20:58:13 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:13 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" returned: 0 in 0.684s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" released by "_copy_volume_from_snapshot" :: held 5.539s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-88c986d1-a4dc-439b-b25a-827192db7f61-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" released by "_create_volume_from_snapshot" :: held 5.561s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.575s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6cd2d5-d25a-462b-abd1-a67f079852b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8', 'volume_size': 2, 'snapshot_id': '88c986d1-a4dc-439b-b25a-827192db7f61'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bea769f-215b-4463-8d5f-0b6202e321a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:13 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Volume volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 (7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8): created successfully Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bea769f-215b-4463-8d5f-0b6202e321a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (6223a2cf-8739-407a-b29e-067298dde5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:13 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-6483c91e-4b91-403a-a9c3-5b589cf1077e tempest-VolumesSnapshotTestJSON-666154326 None] Created volume successfully. Apr 21 20:58:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:14 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547e896-7752-483b-85a2-a8cf5b985cc4]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:14 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 Apr 21 20:58:14 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" returned: 0 in 0.604s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8 Apr 21 20:58:15 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8" released by "delete_volume" :: held 1.145s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['2f8ddf69-3bf3-4b4c-a19f-94ed0c351be4', '7a5251e2-097e-4392-81ad-853ace5e8cf0', '4e673294-44a3-4dc7-9023-7db05d8f72ed', '30cc6e7f-b9dc-490a-aac1-20ddf50d17b5'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:15 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:16 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.524s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:16 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Deleted volume successfully. Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a0efd032-50c4-43c5-9f8e-a4da1a62605d tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-7f6fd7b9-feb0-4d18-9eb7-8fe19f194be8-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-88c986d1-a4dc-439b-b25a-827192db7f61-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-88c986d1-a4dc-439b-b25a-827192db7f61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-c6ba8628-38e5-4329-bcb1-0ee592370e08" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-c6ba8628-38e5-4329-bcb1-0ee592370e08" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-88c986d1-a4dc-439b-b25a-827192db7f61" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-88c986d1-a4dc-439b-b25a-827192db7f61" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Deleting offline snapshot 88c986d1-a4dc-439b-b25a-827192db7f61 of volume c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] snapshot_file for this snap is: volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[67794eb5-0977-494a-9b60-bc8949e3c676]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:16 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 Apr 21 20:58:16 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:17 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61" returned: 0 in 0.655s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ba8628-38e5-4329-bcb1-0ee592370e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:17 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceefbdb-18e8-437a-8ea1-34673c83a0cc]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:17 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 Apr 21 20:58:17 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:18 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08" returned: 0 in 0.606s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:18 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 Apr 21 20:58:18 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:18 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61" returned: 0 in 0.541s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:18 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61 Apr 21 20:58:18 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:19 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08.88c986d1-a4dc-439b-b25a-827192db7f61" returned: 0 in 0.590s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-88c986d1-a4dc-439b-b25a-827192db7f61" released by "_delete_snapshot" :: held 2.454s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-c6ba8628-38e5-4329-bcb1-0ee592370e08" released by "delete_snapshot" :: held 2.468s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:19 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['738d228c-8618-4535-942c-cb260182be56', 'ad3244a6-1a88-4933-9836-a431df175b2b', '48c4ae84-30ea-425b-8645-d8f84c904cb7', '2edf43cb-20c2-4f33-990c-b88c47195bf6'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Delete snapshot completed successfully. Apr 21 20:58:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b1e5980a-f225-44fb-8472-8b31d01c8569 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-88c986d1-a4dc-439b-b25a-827192db7f61-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-c6ba8628-38e5-4329-bcb1-0ee592370e08-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-c6ba8628-38e5-4329-bcb1-0ee592370e08-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-c6ba8628-38e5-4329-bcb1-0ee592370e08" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-c6ba8628-38e5-4329-bcb1-0ee592370e08" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[11812ac8-1d95-46ba-96aa-6031c836e5c5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:20 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 Apr 21 20:58:20 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:20 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08" returned: 0 in 0.678s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:20 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08 Apr 21 20:58:20 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:21 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c6ba8628-38e5-4329-bcb1-0ee592370e08" returned: 0 in 0.527s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-c6ba8628-38e5-4329-bcb1-0ee592370e08" released by "delete_volume" :: held 1.260s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['adaec80f-c61e-4324-8a39-a287f10f1de6', '256d0007-6b39-407f-9305-ef19e2849a47', '26bb9a23-7000-4680-be99-26bfff090e1d', '55312752-aa5c-4a7b-85ee-fd0f83d3b56f'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:21 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:21 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:22 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.577s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:22 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Deleted volume successfully. Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2c137612-fb6a-4619-a85d-97d08139c4bf tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-c6ba8628-38e5-4329-bcb1-0ee592370e08-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (83e3c4d3-c429-45f4-8cf5-2858d1e5942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ada74d4-1d98-4b8e-bf6e-209af6d4daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ada74d4-1d98-4b8e-bf6e-209af6d4daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-926698415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6031a882-f91b-40a6-8bba-f7f957aae99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:23Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3796bcb3-7822-44ee-a316-6781e8f62dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3796bcb3-7822-44ee-a316-6781e8f62dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecd93b2-d910-41c3-b6be-2cb301ce1c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cecd93b2-d910-41c3-b6be-2cb301ce1c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6031a882-f91b-40a6-8bba-f7f957aae99e', 'volume_name': 'volume-6031a882-f91b-40a6-8bba-f7f957aae99e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61362ab-7d6e-4e1e-9b7c-2b0d969d1b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61362ab-7d6e-4e1e-9b7c-2b0d969d1b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98eb7e9a-5148-43d5-9e85-ef8539f57bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:22 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Volume 6031a882-f91b-40a6-8bba-f7f957aae99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6031a882-f91b-40a6-8bba-f7f957aae99e', 'volume_size': 1} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-926698415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6031a882-f91b-40a6-8bba-f7f957aae99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:23Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Creating volume 6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:22 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:58:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:22 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e 1073741824 Apr 21 20:58:22 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:23 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e 1073741824" returned: 0 in 0.625s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:23 devstack sudo[89043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e Apr 21 20:58:23 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:23 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e" returned: 0 in 0.472s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98eb7e9a-5148-43d5-9e85-ef8539f57bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6031a882-f91b-40a6-8bba-f7f957aae99e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3f3653-2154-40c9-a074-822cb29529bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:23 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Volume volume-6031a882-f91b-40a6-8bba-f7f957aae99e (6031a882-f91b-40a6-8bba-f7f957aae99e): created successfully Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3f3653-2154-40c9-a074-822cb29529bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (83e3c4d3-c429-45f4-8cf5-2858d1e5942a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-898d5bea-e892-44eb-b60a-7424ae35c6e6 tempest-VolumesSnapshotTestJSON-666154326 None] Created volume successfully. Apr 21 20:58:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Creating offline snapshot 43459530-b556-42e1-a804-d1771d50c02d of volume 6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:24 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9a92cb-7705-4aee-8956-60306c7c1c17]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:25 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e Apr 21 20:58:25 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:25 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e" returned: 0 in 0.620s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:25 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d 1G Apr 21 20:58:25 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:26 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d 1G" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6031a882-f91b-40a6-8bba-f7f957aae99e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:26 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6031a882-f91b-40a6-8bba-f7f957aae99e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d Apr 21 20:58:26 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:26 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6031a882-f91b-40a6-8bba-f7f957aae99e -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d" returned: 0 in 0.514s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:26 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d is being set with open permissions: ugo+rw Apr 21 20:58:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:26 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d Apr 21 20:58:26 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:27 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d" returned: 0 in 0.654s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:27 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.info Apr 21 20:58:27 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:27 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Flow 'volume_create_manager' (478838f7-7ffb-4eb4-81cd-de714af0230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3e5bd7-54ce-4b3d-82f6-5b42ac124a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.info" returned: 0 in 0.512s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:27 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.info is being set with open permissions: ugo+rw Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3e5bd7-54ce-4b3d-82f6-5b42ac124a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-411677634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69b438e-f78d-4c14-bad0-ac88cbf22887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f43ca62af5b4b57b78bdd419f6d02f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:28Z,use_quota=True,user_id='2335e2c1f0204124acf2d11784dee907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac49cfe5-e4d6-416c-983e-f81962cd92d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:27 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.info Apr 21 20:58:27 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac49cfe5-e4d6-416c-983e-f81962cd92d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3385c45-6c0d-43f6-a3b0-0630aa6b8683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3385c45-6c0d-43f6-a3b0-0630aa6b8683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69b438e-f78d-4c14-bad0-ac88cbf22887', 'volume_name': 'volume-a69b438e-f78d-4c14-bad0-ac88cbf22887', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cabec01-cbf1-458a-8ee1-2b4cec9ac909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cabec01-cbf1-458a-8ee1-2b4cec9ac909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a2a0fa-3289-4743-8985-2ec21d5294df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:27 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Volume a69b438e-f78d-4c14-bad0-ac88cbf22887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69b438e-f78d-4c14-bad0-ac88cbf22887', 'volume_size': 1} Apr 21 20:58:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:28 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.info" returned: 0 in 0.491s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.423s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.451s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-411677634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69b438e-f78d-4c14-bad0-ac88cbf22887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f43ca62af5b4b57b78bdd419f6d02f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:28Z,use_quota=True,user_id='2335e2c1f0204124acf2d11784dee907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Creating volume a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:28 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:28 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 1073741824 Apr 21 20:58:28 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-66d484e4-4c1c-40b0-bd7a-1cdc4b232a31 tempest-VolumesSnapshotTestJSON-666154326 None] Create snapshot completed successfully Apr 21 20:58:28 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 1073741824" returned: 0 in 0.591s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:28 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 Apr 21 20:58:28 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (c81f3a2f-b3c5-426a-909e-4bdba6a1bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e01bd0a-b38f-4655-a7d2-071871be66e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e01bd0a-b38f-4655-a7d2-071871be66e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1257343776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3696d472-201f-419b-b99c-e689170e0b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69699b1cd0754bd19ab932e86a8c3fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43459530-b556-42e1-a804-d1771d50c02d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:29Z,use_quota=True,user_id='214edd821b7743fda7c944a9cf8b3823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:29 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbd30f0-9f7e-4241-8b18-82895793d5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbd30f0-9f7e-4241-8b18-82895793d5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f05e17-8b73-42d3-9ad7-ef95519c0424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f05e17-8b73-42d3-9ad7-ef95519c0424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3696d472-201f-419b-b99c-e689170e0b54', 'volume_name': 'volume-3696d472-201f-419b-b99c-e689170e0b54', 'volume_size': 1, 'snapshot_id': '43459530-b556-42e1-a804-d1771d50c02d'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369c247f-fe6f-4cfa-91ff-cc758b96210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369c247f-fe6f-4cfa-91ff-cc758b96210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7516d9-325f-4727-810f-5c7142a756ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:29 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Volume 3696d472-201f-419b-b99c-e689170e0b54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3696d472-201f-419b-b99c-e689170e0b54', 'volume_size': 1, 'snapshot_id': '43459530-b556-42e1-a804-d1771d50c02d'} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887" returned: 0 in 0.590s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-43459530-b556-42e1-a804-d1771d50c02d-3696d472-201f-419b-b99c-e689170e0b54" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a2a0fa-3289-4743-8985-2ec21d5294df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69b438e-f78d-4c14-bad0-ac88cbf22887', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597f2dc5-2cfe-49ac-a806-d4bcff4a8dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-43459530-b556-42e1-a804-d1771d50c02d-3696d472-201f-419b-b99c-e689170e0b54" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Creating volume 3696d472-201f-419b-b99c-e689170e0b54 from snapshot 43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-3696d472-201f-419b-b99c-e689170e0b54" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:29 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Volume volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 (a69b438e-f78d-4c14-bad0-ac88cbf22887): created successfully Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597f2dc5-2cfe-49ac-a806-d4bcff4a8dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Flow 'volume_create_manager' (478838f7-7ffb-4eb4-81cd-de714af0230b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:29 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7b98282f-054d-46e5-be19-88d340096382 tempest-SnapshotDependencyTests-700403169 None] Created volume successfully. Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-3696d472-201f-419b-b99c-e689170e0b54" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] snapshot: 43459530-b556-42e1-a804-d1771d50c02d, volume: 3696d472-201f-419b-b99c-e689170e0b54, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e209a069-1361-4cff-bcae-b0d0f1757763]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:29 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d Apr 21 20:58:29 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:30 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d" returned: 0 in 0.606s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6031a882-f91b-40a6-8bba-f7f957aae99e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[16026488-5faf-4e72-8816-f4107a779f4e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:30 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e Apr 21 20:58:30 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:30 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e" returned: 0 in 0.563s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:58:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:30 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 Apr 21 20:58:30 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:33 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54" returned: 0 in 2.454s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:33 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52d7d2-ee33-4ea6-a713-bcc9cd00a8ec]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:33 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e Apr 21 20:58:33 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:33 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e" returned: 0 in 0.581s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:33 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:33 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Converted 1024.00 MB image at 416.99 MB/s Apr 21 20:58:33 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 is being set with open permissions: ugo+rw Apr 21 20:58:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:33 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 Apr 21 20:58:33 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:34 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54" returned: 0 in 0.482s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-3696d472-201f-419b-b99c-e689170e0b54" released by "_copy_volume_from_snapshot" :: held 4.784s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-43459530-b556-42e1-a804-d1771d50c02d-3696d472-201f-419b-b99c-e689170e0b54" released by "_create_volume_from_snapshot" :: held 4.841s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.873s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.302s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Creating offline snapshot c20c679b-4624-45b1-b7af-ae80e5a0b943 of volume a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c02496-905a-49cf-96b7-d370908c3fbf]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7516d9-325f-4727-810f-5c7142a756ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3696d472-201f-419b-b99c-e689170e0b54', 'volume_size': 1, 'snapshot_id': '43459530-b556-42e1-a804-d1771d50c02d'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09836e-be54-4c2f-8b68-6241c6a9d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:34 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Volume volume-3696d472-201f-419b-b99c-e689170e0b54 (3696d472-201f-419b-b99c-e689170e0b54): created successfully Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09836e-be54-4c2f-8b68-6241c6a9d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Flow 'volume_create_manager' (c81f3a2f-b3c5-426a-909e-4bdba6a1bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (b75db574-c42b-4ff6-9f8d-5547b5822362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac180ec6-9e56-4648-b843-32e8fe875b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac180ec6-9e56-4648-b843-32e8fe875b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1714734796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b50f0c4-a1a0-4d65-abe3-ac37a79b012f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:34Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaad4f2-9caa-49cf-a0a2-b40aba1a8c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:34 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 Apr 21 20:58:34 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaad4f2-9caa-49cf-a0a2-b40aba1a8c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245820da-cce0-4763-8d8b-8aac4520c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245820da-cce0-4763-8d8b-8aac4520c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b50f0c4-a1a0-4d65-abe3-ac37a79b012f', 'volume_name': 'volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a7b4c0-1ec6-45d7-bc22-7d236c344f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a7b4c0-1ec6-45d7-bc22-7d236c344f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86db860e-9063-4c23-af48-551aa81afd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:34 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Volume 2b50f0c4-a1a0-4d65-abe3-ac37a79b012f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f', 'volume_size': 1} Apr 21 20:58:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:34 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d06e42f8-2ba1-47e1-8a17-60e2b38d5c83 tempest-VolumesSnapshotTestJSON-666154326 None] Created volume successfully. Apr 21 20:58:35 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887" returned: 0 in 0.568s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 1G Apr 21 20:58:35 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-3696d472-201f-419b-b99c-e689170e0b54-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-3696d472-201f-419b-b99c-e689170e0b54-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-3696d472-201f-419b-b99c-e689170e0b54" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-3696d472-201f-419b-b99c-e689170e0b54" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4107b6d1-da68-43df-989e-b76cb2cb3ac7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 Apr 21 20:58:35 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 1G" returned: 0 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 Apr 21 20:58:35 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54" returned: 0 in 0.532s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54 Apr 21 20:58:35 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943" returned: 0 in 0.436s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 is being set with open permissions: ugo+rw Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 Apr 21 20:58:36 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3696d472-201f-419b-b99c-e689170e0b54" returned: 0 in 0.433s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-3696d472-201f-419b-b99c-e689170e0b54" released by "delete_volume" :: held 1.000s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['9032b6c4-c5b3-468b-9130-86b8602fee08', '2026bb0b-ff50-4ee9-8705-ac3fb8449e2d', '804feaa7-2cea-4f43-9a20-1f9e53974a80', 'ae43c485-d31d-4dec-a6c0-ac8142ca82d0'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:36 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943" returned: 0 in 0.462s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.info Apr 21 20:58:36 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:36 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Deleted volume successfully. Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d27bb12c-a865-47fb-9e85-2988dc5e86aa tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-3696d472-201f-419b-b99c-e689170e0b54-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:36 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.info" returned: 0 in 0.418s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.info is being set with open permissions: ugo+rw Apr 21 20:58:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.info Apr 21 20:58:36 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-43459530-b556-42e1-a804-d1771d50c02d-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-43459530-b556-42e1-a804-d1771d50c02d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-6031a882-f91b-40a6-8bba-f7f957aae99e" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-6031a882-f91b-40a6-8bba-f7f957aae99e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-43459530-b556-42e1-a804-d1771d50c02d" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-43459530-b556-42e1-a804-d1771d50c02d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Deleting offline snapshot 43459530-b556-42e1-a804-d1771d50c02d of volume 6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] snapshot_file for this snap is: volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0364706a-97ec-48a7-ab1a-fad5bbcb2e57]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.info" returned: 0 in 0.473s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.011s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.843s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1714734796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b50f0c4-a1a0-4d65-abe3-ac37a79b012f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:34Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Creating volume 2b50f0c4-a1a0-4d65-abe3-ac37a79b012f {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:37 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f 1073741824 Apr 21 20:58:37 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:37 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2b2d87bf-b5a8-4e36-b905-6d9b7916c527 tempest-SnapshotDependencyTests-700403169 None] Create snapshot completed successfully Apr 21 20:58:37 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d Apr 21 20:58:37 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:37 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d" returned: 0 in 0.511s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6031a882-f91b-40a6-8bba-f7f957aae99e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1127e2-7316-4898-ac9f-65983a473912]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f 1073741824" returned: 0 in 0.504s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f Apr 21 20:58:37 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:38 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e Apr 21 20:58:38 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:38 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" returned: 0 in 0.431s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86db860e-9063-4c23-af48-551aa81afd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06841e45-10ac-4dae-90aa-86eb48e9316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:38 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Volume volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f (2b50f0c4-a1a0-4d65-abe3-ac37a79b012f): created successfully Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06841e45-10ac-4dae-90aa-86eb48e9316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (b75db574-c42b-4ff6-9f8d-5547b5822362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:38 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d144d3ce-b1b4-4e6f-a3ec-276f21378e16 tempest-VolumesActionsTest-1754928333 None] Created volume successfully. Apr 21 20:58:38 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e" returned: 0 in 0.526s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:38 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d Apr 21 20:58:38 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c463c85e-3457-4e26-8172-7d7856de9ae4 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" by "attach_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c463c85e-3457-4e26-8172-7d7856de9ae4 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" acquired by "attach_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:38 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c463c85e-3457-4e26-8172-7d7856de9ae4 tempest-VolumesActionsTest-1754928333 None] Attaching volume 2b50f0c4-a1a0-4d65-abe3-ac37a79b012f to instance a690557e-0005-42fd-b9d2-9cf3750a3892 at mountpoint /dev/vdb on host None. Apr 21 20:58:38 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c463c85e-3457-4e26-8172-7d7856de9ae4 tempest-VolumesActionsTest-1754928333 None] Attach volume completed successfully. Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c463c85e-3457-4e26-8172-7d7856de9ae4 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" released by "attach_volume" :: held 0.093s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Flow 'volume_create_manager' (f75fdad7-d8cf-4d84-89d0-499a67e5806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58615dfe-96e5-479f-990a-87f23dabe16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58615dfe-96e5-479f-990a-87f23dabe16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839b0b37-9d87-4ced-89f7-11aa02a3391c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f43ca62af5b4b57b78bdd419f6d02f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c20c679b-4624-45b1-b7af-ae80e5a0b943,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:39Z,use_quota=True,user_id='2335e2c1f0204124acf2d11784dee907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac8d1b8-220c-4241-b6f8-47b868a3e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac8d1b8-220c-4241-b6f8-47b868a3e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63d42ab-2e79-4e29-a402-81650ac2714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63d42ab-2e79-4e29-a402-81650ac2714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '839b0b37-9d87-4ced-89f7-11aa02a3391c', 'volume_name': 'volume-839b0b37-9d87-4ced-89f7-11aa02a3391c', 'volume_size': 1, 'snapshot_id': 'c20c679b-4624-45b1-b7af-ae80e5a0b943'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d3ba86-612d-47ed-95e7-f36f65e8e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d3ba86-612d-47ed-95e7-f36f65e8e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534af78e-0ea2-485a-8ba2-8c5f3818a6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:38 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Volume 839b0b37-9d87-4ced-89f7-11aa02a3391c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-839b0b37-9d87-4ced-89f7-11aa02a3391c', 'volume_size': 1, 'snapshot_id': 'c20c679b-4624-45b1-b7af-ae80e5a0b943'} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-quobyte-c20c679b-4624-45b1-b7af-ae80e5a0b943-839b0b37-9d87-4ced-89f7-11aa02a3391c" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-c20c679b-4624-45b1-b7af-ae80e5a0b943-839b0b37-9d87-4ced-89f7-11aa02a3391c" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Creating volume 839b0b37-9d87-4ced-89f7-11aa02a3391c from snapshot c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-quobyte-839b0b37-9d87-4ced-89f7-11aa02a3391c" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-839b0b37-9d87-4ced-89f7-11aa02a3391c" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] snapshot: c20c679b-4624-45b1-b7af-ae80e5a0b943, volume: 839b0b37-9d87-4ced-89f7-11aa02a3391c, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:58:39 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d" returned: 0 in 0.558s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8cabd-1852-442e-aae5-7e079a810830]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d Apr 21 20:58:39 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 Apr 21 20:58:39 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e.43459530-b556-42e1-a804-d1771d50c02d" returned: 0 in 0.485s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-43459530-b556-42e1-a804-d1771d50c02d" released by "_delete_snapshot" :: held 2.175s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-6031a882-f91b-40a6-8bba-f7f957aae99e" released by "delete_snapshot" :: held 2.187s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['ee2992db-d648-42d1-82f2-b68a6753f73e', '0358c27e-d912-465c-ba8d-e468d9efa03e', 'f7541438-8a87-4650-9cc5-b9ecf06ab79f', '6e5df1ce-b890-48f4-89c5-2187eef50f87'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:39 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943" returned: 0 in 0.609s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Delete snapshot completed successfully. Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a69b438e-f78d-4c14-bad0-ac88cbf22887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49165d5-3a94-4be3-8170-feb6eade5739]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-87bed4e7-30fe-45f4-9c98-3c31f76ff483 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-43459530-b556-42e1-a804-d1771d50c02d-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a7a5c182-4e4c-4bb7-86b4-49358b32dc2b tempest-VolumesActionsTest-1467535081 None] Terminate volume connection completed successfully. Apr 21 20:58:39 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 Apr 21 20:58:39 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a7a5c182-4e4c-4bb7-86b4-49358b32dc2b tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-detach_volume" by "detach_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a7a5c182-4e4c-4bb7-86b4-49358b32dc2b tempest-VolumesActionsTest-1467535081 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:40 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a7a5c182-4e4c-4bb7-86b4-49358b32dc2b tempest-VolumesActionsTest-1467535081 None] Detaching volume 2b50f0c4-a1a0-4d65-abe3-ac37a79b012f from instance a690557e-0005-42fd-b9d2-9cf3750a3892. Apr 21 20:58:40 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887" returned: 0 in 0.541s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:40 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c Apr 21 20:58:40 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:40 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a7a5c182-4e4c-4bb7-86b4-49358b32dc2b tempest-VolumesActionsTest-1467535081 None] Detach volume completed successfully. Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a7a5c182-4e4c-4bb7-86b4-49358b32dc2b tempest-VolumesActionsTest-1467535081 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-6031a882-f91b-40a6-8bba-f7f957aae99e-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-6031a882-f91b-40a6-8bba-f7f957aae99e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-6031a882-f91b-40a6-8bba-f7f957aae99e" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-6031a882-f91b-40a6-8bba-f7f957aae99e" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15cbbe7-76e0-41be-b299-5fdaf5a977b2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:40 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e Apr 21 20:58:40 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4dc6df9-ed31-49f2-8434-5633395ee5c9 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-detach_volume" by "detach_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:41 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4dc6df9-ed31-49f2-8434-5633395ee5c9 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-detach_volume" acquired by "detach_volume" :: waited 0.106s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:41 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d4dc6df9-ed31-49f2-8434-5633395ee5c9 tempest-VolumesActionsTest-1754928333 None] Volume detach called, but volume not attached. Apr 21 20:58:41 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d4dc6df9-ed31-49f2-8434-5633395ee5c9 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-detach_volume" released by "detach_volume" :: held 0.159s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "cinder-quobyte-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-quobyte-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" acquired by "delete_volume" :: waited 0.045s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77fd95a-b776-497a-849c-5e161e121966]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:42 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e" returned: 0 in 2.013s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:42 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e Apr 21 20:58:42 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:42 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f Apr 21 20:58:42 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c" returned: 0 in 3.057s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[553265be-ffda-458b-9ceb-f0c3ba5fd7dd]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 Apr 21 20:58:43 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" returned: 0 in 1.171s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f Apr 21 20:58:43 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6031a882-f91b-40a6-8bba-f7f957aae99e" returned: 0 in 0.890s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-6031a882-f91b-40a6-8bba-f7f957aae99e" released by "delete_volume" :: held 2.957s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['5ac03e88-9ddc-4de2-86c3-e7a8ee2aedfc', '4ebf837f-51de-4a9f-926d-d7a427236850', 'dc2c7621-4e55-44b9-ac67-39b449d4c8f2', '6a488574-a75d-4594-8f1a-35853058acbc'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:43 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887" returned: 0 in 0.680s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887, size 1024.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:43 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Converted 1024.00 MB image at 334.82 MB/s Apr 21 20:58:43 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c is being set with open permissions: ugo+rw Apr 21 20:58:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c Apr 21 20:58:43 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:44 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" returned: 0 in 0.526s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-quobyte-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f" released by "delete_volume" :: held 1.744s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Created reservations ['453e2d55-9ff6-4b35-bbad-5966780309c3', 'fb18abb2-ad50-4650-8f7e-b805c02e5d22', 'b36fe6da-3b31-49e6-a83f-a418037058bf', 'c3cc5556-ddd8-470e-9ddf-66e3a2c42582'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:44 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:44 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.532s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:44 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Deleted volume successfully. Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-8f1c5497-94a5-4d25-8034-f78d9c96393a tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-6031a882-f91b-40a6-8bba-f7f957aae99e-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-693703b0-7656-49e7-b9ba-3c45f061fe75-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-693703b0-7656-49e7-b9ba-3c45f061fe75-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "cinder-quobyte-693703b0-7656-49e7-b9ba-3c45f061fe75" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-693703b0-7656-49e7-b9ba-3c45f061fe75" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8248acb7-f90f-4411-acfb-6b82d495be79]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:44 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c" returned: 0 in 0.582s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-839b0b37-9d87-4ced-89f7-11aa02a3391c" released by "_copy_volume_from_snapshot" :: held 5.566s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-c20c679b-4624-45b1-b7af-ae80e5a0b943-839b0b37-9d87-4ced-89f7-11aa02a3391c" released by "_create_volume_from_snapshot" :: held 5.592s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.601s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (534af78e-0ea2-485a-8ba2-8c5f3818a6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839b0b37-9d87-4ced-89f7-11aa02a3391c', 'volume_size': 1, 'snapshot_id': 'c20c679b-4624-45b1-b7af-ae80e5a0b943'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901cf7fe-987d-4c51-8ea6-379f2914cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Volume volume-839b0b37-9d87-4ced-89f7-11aa02a3391c (839b0b37-9d87-4ced-89f7-11aa02a3391c): created successfully Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901cf7fe-987d-4c51-8ea6-379f2914cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:44 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 Apr 21 20:58:44 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Flow 'volume_create_manager' (f75fdad7-d8cf-4d84-89d0-499a67e5806b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-dcf6dc94-a40c-44f2-b9a0-dfda5ac8d75a tempest-SnapshotDependencyTests-700403169 None] Created volume successfully. Apr 21 20:58:44 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.643s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Deleted volume successfully. Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6c49b6cb-f8cb-49f3-997c-12a3253a4572 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-2b50f0c4-a1a0-4d65-abe3-ac37a79b012f-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-c20c679b-4624-45b1-b7af-ae80e5a0b943-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-c20c679b-4624-45b1-b7af-ae80e5a0b943-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-quobyte-a69b438e-f78d-4c14-bad0-ac88cbf22887" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-a69b438e-f78d-4c14-bad0-ac88cbf22887" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-quobyte-c20c679b-4624-45b1-b7af-ae80e5a0b943" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-c20c679b-4624-45b1-b7af-ae80e5a0b943" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Deleting offline snapshot c20c679b-4624-45b1-b7af-ae80e5a0b943 of volume a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] snapshot_file for this snap is: volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd86ac-f385-4c59-baf4-07009b93018b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 Apr 21 20:58:45 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75" returned: 0 in 0.625s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75 Apr 21 20:58:45 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943" returned: 0 in 0.542s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a69b438e-f78d-4c14-bad0-ac88cbf22887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b13b91f-ed38-434f-aeef-fdd57486c571]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 Apr 21 20:58:45 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-693703b0-7656-49e7-b9ba-3c45f061fe75" returned: 0 in 0.528s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-quobyte-693703b0-7656-49e7-b9ba-3c45f061fe75" released by "delete_volume" :: held 1.254s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Created reservations ['5236ed60-a7ed-4a07-aa21-a096f17d1004', '7a3cacaf-21e8-4007-8fd5-603e0381705f', 'da8a7cd1-d4de-4e4a-b1c3-cbb83d456327', 'b6fda34d-d7a4-4127-af4e-9caa036bd2dc'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:45 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:45 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887" returned: 0 in 0.609s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 Apr 21 20:58:46 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.561s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:46 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Deleted volume successfully. Apr 21 20:58:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-777d85ad-cfe9-4765-9fdd-7402dde11e63 tempest-VolumesSnapshotTestJSON-666154326 None] Lock "cinder-693703b0-7656-49e7-b9ba-3c45f061fe75-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:46 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943" returned: 0 in 0.524s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943 Apr 21 20:58:46 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:47 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887.c20c679b-4624-45b1-b7af-ae80e5a0b943" returned: 0 in 0.511s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-c20c679b-4624-45b1-b7af-ae80e5a0b943" released by "_delete_snapshot" :: held 2.298s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-a69b438e-f78d-4c14-bad0-ac88cbf22887" released by "delete_snapshot" :: held 2.333s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:47 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Created reservations ['991cb007-f5a1-46cd-a6cf-6dbda3982b84', '5f845900-be7d-44db-93d9-d8d1fddb0393', '79db0ecf-3558-445e-b6b4-c4fc72479d61', 'c97c65e1-da8c-4a71-82b0-afb6d5e656ab'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Delete snapshot completed successfully. Apr 21 20:58:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c65c7c25-92f7-425d-985a-43137c96fafa tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-c20c679b-4624-45b1-b7af-ae80e5a0b943-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-a69b438e-f78d-4c14-bad0-ac88cbf22887-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-a69b438e-f78d-4c14-bad0-ac88cbf22887-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-quobyte-a69b438e-f78d-4c14-bad0-ac88cbf22887" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-a69b438e-f78d-4c14-bad0-ac88cbf22887" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e494b79-19f3-4de3-812a-8386c1476a30]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:48 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 Apr 21 20:58:48 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:48 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887" returned: 0 in 0.612s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:48 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887 Apr 21 20:58:48 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a69b438e-f78d-4c14-bad0-ac88cbf22887" returned: 0 in 0.563s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-a69b438e-f78d-4c14-bad0-ac88cbf22887" released by "delete_volume" :: held 1.215s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Created reservations ['5610f01c-bfd5-41d0-8b51-1efb64bf4b14', 'abaabd9c-7df7-40d3-901c-97fb171fbccd', '610b77c0-ae2e-46d8-be8a-4553ab3eb188', 'bdae9a6a-1136-4521-b8a2-2c3f85888616'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:49 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Deleted volume successfully. Apr 21 20:58:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f42d24e1-940e-4815-895a-9cc8e0d0c453 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-a69b438e-f78d-4c14-bad0-ac88cbf22887-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-839b0b37-9d87-4ced-89f7-11aa02a3391c-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-839b0b37-9d87-4ced-89f7-11aa02a3391c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "cinder-quobyte-839b0b37-9d87-4ced-89f7-11aa02a3391c" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-839b0b37-9d87-4ced-89f7-11aa02a3391c" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca7075-b9c5-410e-a414-1752b0d993c4]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:50 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c Apr 21 20:58:50 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:50 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c" returned: 0 in 0.573s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:50 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c Apr 21 20:58:50 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (2629174d-c260-4e95-b9b7-be84ca674b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b76250b-3ed8-4a02-b434-712bd729bc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b76250b-3ed8-4a02-b434-712bd729bc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-558422681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52307002-399c-4151-813e-253b09ccc187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:51Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ccb3c3c-5d80-40c7-a798-8083e070bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ccb3c3c-5d80-40c7-a798-8083e070bc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f407c6a5-8dab-49a9-b30d-676aabdaa673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f407c6a5-8dab-49a9-b30d-676aabdaa673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52307002-399c-4151-813e-253b09ccc187', 'volume_name': 'volume-52307002-399c-4151-813e-253b09ccc187', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bb141e-4e2a-4daf-a040-7038a422c043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bb141e-4e2a-4daf-a040-7038a422c043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1f477-66a6-4ffc-8c61-e170d734b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:51 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Volume 52307002-399c-4151-813e-253b09ccc187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52307002-399c-4151-813e-253b09ccc187', 'volume_size': 1} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-558422681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52307002-399c-4151-813e-253b09ccc187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:51Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Creating volume 52307002-399c-4151-813e-253b09ccc187 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:51 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 1073741824 Apr 21 20:58:51 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Flow 'volume_create_manager' (a598a3a5-f4ae-484f-85f1-b0928f34c067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cbe414-027c-420c-8952-188d67509fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20cbe414-027c-420c-8952-188d67509fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2090058153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943aa576-8382-439b-93c2-b1e15883399d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb051fdc80c4589826037f44bcb544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:51Z,use_quota=True,user_id='789c0fa822c94120a848d44fd6947a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae045c4-2ec2-4500-abb6-c96bd3d241a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae045c4-2ec2-4500-abb6-c96bd3d241a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9a2a0f-1ff0-4a8a-ab2f-72650780654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9a2a0f-1ff0-4a8a-ab2f-72650780654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943aa576-8382-439b-93c2-b1e15883399d', 'volume_name': 'volume-943aa576-8382-439b-93c2-b1e15883399d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f90fdf-898a-42ea-92b9-57e432d786c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f90fdf-898a-42ea-92b9-57e432d786c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5255209-fe43-446c-96d8-ef8a70d7fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:51 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Volume 943aa576-8382-439b-93c2-b1e15883399d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943aa576-8382-439b-93c2-b1e15883399d', 'volume_size': 1} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:51 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-839b0b37-9d87-4ced-89f7-11aa02a3391c" returned: 0 in 0.527s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-quobyte-839b0b37-9d87-4ced-89f7-11aa02a3391c" released by "delete_volume" :: held 1.134s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Created reservations ['a7fcbb53-225e-47ff-82de-a31a28632927', 'ae9d191c-5e08-423b-b269-49ed2cf075ae', '704421ab-bbe2-47fc-b004-ded5518f9bee', '9afad89b-850b-4d86-8472-0fd4384616b9'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:51 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 1073741824" returned: 0 in 0.595s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 Apr 21 20:58:51 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.421s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:51 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Deleted volume successfully. Apr 21 20:58:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b5bfbcce-32dd-4d54-938f-74829c9eadf9 tempest-SnapshotDependencyTests-700403169 None] Lock "cinder-839b0b37-9d87-4ced-89f7-11aa02a3391c-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:52 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187" returned: 0 in 0.441s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2090058153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943aa576-8382-439b-93c2-b1e15883399d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceb051fdc80c4589826037f44bcb544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:51Z,use_quota=True,user_id='789c0fa822c94120a848d44fd6947a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Creating volume 943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:52 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1f477-66a6-4ffc-8c61-e170d734b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52307002-399c-4151-813e-253b09ccc187', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:52 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d 1073741824 Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5a2b8c-36b2-4259-84b0-c2deb37ec9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:52 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:52 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Volume volume-52307002-399c-4151-813e-253b09ccc187 (52307002-399c-4151-813e-253b09ccc187): created successfully Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5a2b8c-36b2-4259-84b0-c2deb37ec9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (2629174d-c260-4e95-b9b7-be84ca674b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4a0a9f3d-0321-4b74-a2b6-913bcc66d981 tempest-VolumesActionsTest-1754928333 None] Created volume successfully. Apr 21 20:58:52 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d 1073741824" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d Apr 21 20:58:52 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d" returned: 0 in 0.457s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5255209-fe43-446c-96d8-ef8a70d7fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943aa576-8382-439b-93c2-b1e15883399d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f575d5-1d6f-4880-99bb-967f0697d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:53 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Volume volume-943aa576-8382-439b-93c2-b1e15883399d (943aa576-8382-439b-93c2-b1e15883399d): created successfully Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f575d5-1d6f-4880-99bb-967f0697d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Flow 'volume_create_manager' (a598a3a5-f4ae-484f-85f1-b0928f34c067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-bd975b0e-730e-4384-9ab9-3bbb77b8cc96 tempest-VolumesSnapshotListTestJSON-978107127 None] Created volume successfully. Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-52307002-399c-4151-813e-253b09ccc187-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-52307002-399c-4151-813e-253b09ccc187-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-quobyte-52307002-399c-4151-813e-253b09ccc187" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-52307002-399c-4151-813e-253b09ccc187" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[492eb82d-1332-4f46-bc9f-35988c3e871a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 Apr 21 20:58:53 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Creating offline snapshot 2fb2911b-2725-43fe-8d52-c1c731950028 of volume 943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b7a0a0-eb3c-45f8-b3a6-c803bf0036a6]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d Apr 21 20:58:53 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187" returned: 0 in 0.537s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187 Apr 21 20:58:53 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d" returned: 0 in 0.537s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 1G Apr 21 20:58:54 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-52307002-399c-4151-813e-253b09ccc187" returned: 0 in 0.503s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-52307002-399c-4151-813e-253b09ccc187" released by "delete_volume" :: held 1.086s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Created reservations ['2155455d-b3f4-441e-af5f-3161d65bdbf2', '87f9d3d0-0c55-4e15-9fdb-8c9b7f10ac6f', '524ddd63-a885-4a3f-8b7a-84df38f44278', '57d0a480-ad34-49b8-8ddf-eb8c6925df98'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:54 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 1G" returned: 0 in 0.531s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 Apr 21 20:58:54 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.563s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Deleted volume successfully. Apr 21 20:58:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e29cccbe-5629-4b1f-9e92-b47ca5015a84 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-52307002-399c-4151-813e-253b09ccc187-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:55 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028" returned: 0 in 0.492s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:55 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 is being set with open permissions: ugo+rw Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:55 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 Apr 21 20:58:55 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:55 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028" returned: 0 in 0.514s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:55 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.info Apr 21 20:58:55 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (1827709d-04fe-40f0-b931-8fdffe89f4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e11add-97c5-4e4c-934f-d72c6fa44d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e11add-97c5-4e4c-934f-d72c6fa44d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1404523674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1914d4-aec5-4324-9839-9e5eb4d5547f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:56Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e53b46-48ec-48c0-abef-15da0e41e8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e53b46-48ec-48c0-abef-15da0e41e8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99ecc7b-9d00-4941-a396-36e8ed0040c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99ecc7b-9d00-4941-a396-36e8ed0040c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1914d4-aec5-4324-9839-9e5eb4d5547f', 'volume_name': 'volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e63eba-b150-4282-99db-62ed5cca8bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e63eba-b150-4282-99db-62ed5cca8bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cd93bf-05aa-4a6b-b5b1-c474f01e4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Volume 6a1914d4-aec5-4324-9839-9e5eb4d5547f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f', 'volume_size': 1} Apr 21 20:58:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:56 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.info" returned: 0 in 0.468s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:56 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.info is being set with open permissions: ugo+rw Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:56 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.info Apr 21 20:58:56 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:56 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.info" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1404523674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1914d4-aec5-4324-9839-9e5eb4d5547f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:56Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Creating volume 6a1914d4-aec5-4324-9839-9e5eb4d5547f {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:56 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:58:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:56 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-8b609e3a-094a-43d9-8734-e0eafd716e9d tempest-VolumesSnapshotListTestJSON-978107127 None] Create snapshot completed successfully Apr 21 20:58:56 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f 1073741824 Apr 21 20:58:56 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:57 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f 1073741824" returned: 0 in 0.514s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:57 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f Apr 21 20:58:57 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:57 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cd93bf-05aa-4a6b-b5b1-c474f01e4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f90e47f-3cda-4454-a992-a3bfc21a7e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:57 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Volume volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f (6a1914d4-aec5-4324-9839-9e5eb4d5547f): created successfully Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f90e47f-3cda-4454-a992-a3bfc21a7e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (1827709d-04fe-40f0-b931-8fdffe89f4fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:57 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9688d513-3927-42ef-b83b-add1d73fe45c tempest-VolumesActionsTest-1754928333 None] Created volume successfully. Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Creating offline snapshot 50b7002c-9b2b-493f-9a0d-49483647ffbe of volume 943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc642a2-6f5f-460a-8802-ce278db8f83c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:57 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 Apr 21 20:58:57 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-6a1914d4-aec5-4324-9839-9e5eb4d5547f-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Lock "cinder-6a1914d4-aec5-4324-9839-9e5eb4d5547f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-quobyte-6a1914d4-aec5-4324-9839-9e5eb4d5547f" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-6a1914d4-aec5-4324-9839-9e5eb4d5547f" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f592303-cc6d-4dc5-9796-58ab64dde8eb]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f Apr 21 20:58:58 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028" returned: 0 in 0.560s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943aa576-8382-439b-93c2-b1e15883399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe 1G Apr 21 20:58:58 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f" returned: 0 in 0.515s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f Apr 21 20:58:58 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe 1G" returned: 0 in 0.563s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe Apr 21 20:58:58 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-6a1914d4-aec5-4324-9839-9e5eb4d5547f" returned: 0 in 0.462s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-6a1914d4-aec5-4324-9839-9e5eb4d5547f" released by "delete_volume" :: held 1.011s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Created reservations ['c2882010-ec08-478a-a503-c5ddb3f928de', 'dd843cda-8688-4ecf-b243-6f50967b0bbe', '62f9afce-a57f-4db7-97eb-482b622b93d0', 'c779c303-407e-4ad7-b54e-dad6c97e21f0'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:58:59 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe" returned: 0 in 0.490s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe is being set with open permissions: ugo+rw Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe Apr 21 20:58:59 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.418s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:59 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Deleted volume successfully. Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-33dfa7b7-3947-41e9-8ca0-03fc4c6b4dbe tempest-VolumesActionsTest-1467535081 None] Lock "cinder-6a1914d4-aec5-4324-9839-9e5eb4d5547f-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:59 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe" returned: 0 in 0.428s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:UPDATE=170,cinder:SELECT=132,cinder:INSERT=45,cinder:DELETE=14 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:59 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e58356f8-b956-4a40-b953-54dd48d0e466 tempest-VolumesSnapshotListTestJSON-978107127 None] Create snapshot completed successfully Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (59a9fc88-8cd7-404e-b6e6-b09391a3904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94248548-c93a-4479-a88f-1a677cf6807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94248548-c93a-4479-a88f-1a677cf6807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-16308252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc0c60b-0813-41f9-baae-fdae822bb520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:00Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8059650-a5f4-43de-99fa-11d2c2bf575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8059650-a5f4-43de-99fa-11d2c2bf575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7796e0-c208-4ec1-9916-c858981fcbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7796e0-c208-4ec1-9916-c858981fcbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc0c60b-0813-41f9-baae-fdae822bb520', 'volume_name': 'volume-0dc0c60b-0813-41f9-baae-fdae822bb520', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091befba-72f8-4e61-b553-fa12e0339da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (091befba-72f8-4e61-b553-fa12e0339da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3720e6-a8c8-48f1-a1b5-4102dd6d0e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Volume 0dc0c60b-0813-41f9-baae-fdae822bb520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc0c60b-0813-41f9-baae-fdae822bb520', 'volume_size': 1} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-16308252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc0c60b-0813-41f9-baae-fdae822bb520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:00Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Creating volume 0dc0c60b-0813-41f9-baae-fdae822bb520 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:00 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:00 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 1073741824 Apr 21 20:59:00 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:01 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 1073741824" returned: 0 in 0.555s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:01 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 Apr 21 20:59:01 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:01 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.508s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:UPDATE=152,cinder:SELECT=123,cinder:INSERT=33,cinder:DELETE=14 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Creating offline snapshot 59049338-51e3-423e-91f0-cd92d8254487 of volume 943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3720e6-a8c8-48f1-a1b5-4102dd6d0e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc0c60b-0813-41f9-baae-fdae822bb520', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c942ddc-dac1-4771-8b85-eb88ea1ba935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd8e978-9e30-4f3e-beac-0792cdb59b1f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:01 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Volume volume-0dc0c60b-0813-41f9-baae-fdae822bb520 (0dc0c60b-0813-41f9-baae-fdae822bb520): created successfully Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c942ddc-dac1-4771-8b85-eb88ea1ba935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (59a9fc88-8cd7-404e-b6e6-b09391a3904e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:01 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3657421d-04bf-4a4d-8fa6-98b7d6b85dc9 tempest-VolumesActionsTest-1754928333 None] Created volume successfully. Apr 21 20:59:01 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe Apr 21 20:59:01 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:02 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe" returned: 0 in 0.509s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943aa576-8382-439b-93c2-b1e15883399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:02 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 1G Apr 21 20:59:02 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:02 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:02 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:02 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 1G" returned: 0 in 0.612s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:02 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 Apr 21 20:59:02 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-0dc0c60b-0813-41f9-baae-fdae822bb520-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-0dc0c60b-0813-41f9-baae-fdae822bb520-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-quobyte-0dc0c60b-0813-41f9-baae-fdae822bb520" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-0dc0c60b-0813-41f9-baae-fdae822bb520" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9570dacd-c316-4fc6-a6e3-089c54e018f5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:02 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 Apr 21 20:59:02 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:03 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.519s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:03 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487" returned: 0 in 0.568s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 is being set with open permissions: ugo+rw Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:03 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 Apr 21 20:59:03 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:03 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520" returned: 0 in 0.566s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:03 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520 Apr 21 20:59:03 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:03 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487" returned: 0 in 0.458s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-cad6e9f2-98bf-4a81-8b91-48e6ad03ce76 tempest-VolumesSnapshotListTestJSON-978107127 None] Create snapshot completed successfully Apr 21 20:59:03 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-0dc0c60b-0813-41f9-baae-fdae822bb520" returned: 0 in 0.435s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-0dc0c60b-0813-41f9-baae-fdae822bb520" released by "delete_volume" :: held 1.026s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Created reservations ['a4ac66b9-0f31-4206-8bc2-19117d0b393b', '1b5a709a-8436-4396-aef4-6fc35993f1b1', '875b3a1a-f668-4dce-a17a-2d4bff94c419', '83a42a6d-135a-4b7a-a785-815d0899d554'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:03 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:03 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:04 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.458s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:04 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Deleted volume successfully. Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-27b2cc75-dc6a-4721-bc86-a24007515b74 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-0dc0c60b-0813-41f9-baae-fdae822bb520-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-59049338-51e3-423e-91f0-cd92d8254487-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-59049338-51e3-423e-91f0-cd92d8254487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-quobyte-59049338-51e3-423e-91f0-cd92d8254487" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-59049338-51e3-423e-91f0-cd92d8254487" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Deleting offline snapshot 59049338-51e3-423e-91f0-cd92d8254487 of volume 943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] snapshot_file for this snap is: volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19819a0-ea80-45eb-a60b-e80ce828bc0a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 Apr 21 20:59:05 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (c1fb22ce-9226-48c2-9c45-266fde2b2f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b425354b-c120-4fe4-9127-ac1338b82a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b425354b-c120-4fe4-9127-ac1338b82a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-37546955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784d8816-23e1-46e2-a997-548213cc09e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:05Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64828925-b92e-4bc1-8327-66cd57cbbe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64828925-b92e-4bc1-8327-66cd57cbbe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477e76e3-d6e8-438e-bf2a-915fcf32b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477e76e3-d6e8-438e-bf2a-915fcf32b148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '784d8816-23e1-46e2-a997-548213cc09e6', 'volume_name': 'volume-784d8816-23e1-46e2-a997-548213cc09e6', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039f3f69-cc58-49c8-aa1d-5940eab77cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039f3f69-cc58-49c8-aa1d-5940eab77cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5d2420-8edd-48f5-bffc-2e6409e54f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:05 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Volume 784d8816-23e1-46e2-a997-548213cc09e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-784d8816-23e1-46e2-a997-548213cc09e6', 'volume_size': 1} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-37546955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784d8816-23e1-46e2-a997-548213cc09e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:05Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Creating volume 784d8816-23e1-46e2-a997-548213cc09e6 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:05 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 1073741824 Apr 21 20:59:05 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:05 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487" returned: 0 in 0.515s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943aa576-8382-439b-93c2-b1e15883399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4433ee02-22c5-4294-97e2-faa80e14b3ab]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe Apr 21 20:59:05 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:05 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 1073741824" returned: 0 in 0.495s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:05 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 Apr 21 20:59:05 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe" returned: 0 in 0.565s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943aa576-8382-439b-93c2-b1e15883399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:06 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 Apr 21 20:59:06 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6" returned: 0 in 0.447s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5d2420-8edd-48f5-bffc-2e6409e54f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784d8816-23e1-46e2-a997-548213cc09e6', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2381d0-8a2b-42a8-966e-35b8027b537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:06 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Volume volume-784d8816-23e1-46e2-a997-548213cc09e6 (784d8816-23e1-46e2-a997-548213cc09e6): created successfully Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2381d0-8a2b-42a8-966e-35b8027b537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (c1fb22ce-9226-48c2-9c45-266fde2b2f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d78b5a32-f822-4841-ba77-fcfcf63197b3 tempest-VolumesActionsTest-1754928333 None] Created volume successfully. Apr 21 20:59:06 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487" returned: 0 in 0.508s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:06 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487 Apr 21 20:59:06 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:07 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.59049338-51e3-423e-91f0-cd92d8254487" returned: 0 in 0.436s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-59049338-51e3-423e-91f0-cd92d8254487" released by "_delete_snapshot" :: held 2.076s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" released by "delete_snapshot" :: held 2.089s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Created reservations ['502941aa-0611-485a-8889-7e2487cb1a3b', '59021373-a314-4fa2-984e-8d3ad48729fc', '6bafda3c-0954-4a75-9e4d-a60bb66883b5', 'd70c44be-2ae2-45f8-9a77-ff5b5aed5d8b'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:07 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Delete snapshot completed successfully. Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-340a33b4-b476-4d79-80de-bb5351ff4569 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-59049338-51e3-423e-91f0-cd92d8254487-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-784d8816-23e1-46e2-a997-548213cc09e6-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-784d8816-23e1-46e2-a997-548213cc09e6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "cinder-quobyte-784d8816-23e1-46e2-a997-548213cc09e6" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-784d8816-23e1-46e2-a997-548213cc09e6" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6726e4-ab2d-48c6-90bc-db27435696d7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:07 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 Apr 21 20:59:07 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:07 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6" returned: 0 in 0.479s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6 Apr 21 20:59:08 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-50b7002c-9b2b-493f-9a0d-49483647ffbe-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-50b7002c-9b2b-493f-9a0d-49483647ffbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-quobyte-50b7002c-9b2b-493f-9a0d-49483647ffbe" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-50b7002c-9b2b-493f-9a0d-49483647ffbe" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Deleting offline snapshot 50b7002c-9b2b-493f-9a0d-49483647ffbe of volume 943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] snapshot_file for this snap is: volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[458cd074-1422-47d7-995a-42ac5f3b3d99]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe Apr 21 20:59:08 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-784d8816-23e1-46e2-a997-548213cc09e6" returned: 0 in 0.435s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-quobyte-784d8816-23e1-46e2-a997-548213cc09e6" released by "delete_volume" :: held 0.940s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Created reservations ['e90cac94-bdb2-4177-b0b5-fa59ee30f40e', '1227855b-4819-4720-be14-df7b9afa16da', '72346279-0e21-4b54-ba8e-7ffe2540e8b4', 'abcf626e-65d9-4b9c-9b7a-ed15fb65bab4'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:08 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe" returned: 0 in 0.545s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943aa576-8382-439b-93c2-b1e15883399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d89abde-150d-4c7d-b65b-83df4397a948]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 Apr 21 20:59:08 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (2813c77c-c782-4e74-89c6-54b67d2b25d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc00e5e-7617-4907-9412-b6c64a0a4ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dc00e5e-7617-4907-9412-b6c64a0a4ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-306172860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1e66fd-db68-4b97-a6f5-e50d406a291b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:09Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1082998-5e44-46b9-9773-6c921bd2063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1082998-5e44-46b9-9773-6c921bd2063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318ba918-920a-487e-996d-f39030bd8b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318ba918-920a-487e-996d-f39030bd8b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1e66fd-db68-4b97-a6f5-e50d406a291b', 'volume_name': 'volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddfc143-afe6-4d2e-b890-6fdc470359a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cddfc143-afe6-4d2e-b890-6fdc470359a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37df9076-33db-4386-b132-3cf8380540ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:08 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Volume 4f1e66fd-db68-4b97-a6f5-e50d406a291b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b', 'volume_size': 1} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-306172860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1e66fd-db68-4b97-a6f5-e50d406a291b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fcda8a52d4bc98341df0e71f8d26d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:09Z,use_quota=True,user_id='003f120ab6d4465188e0a4d07da1ad48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Creating volume 4f1e66fd-db68-4b97-a6f5-e50d406a291b {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:08 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b 1073741824 Apr 21 20:59:08 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.468s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:08 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Deleted volume successfully. Apr 21 20:59:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d574bda4-14e0-4bef-8a62-df8cba1d7927 tempest-VolumesActionsTest-1467535081 None] Lock "cinder-784d8816-23e1-46e2-a997-548213cc09e6-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:09 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028" returned: 0 in 0.631s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943aa576-8382-439b-93c2-b1e15883399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe Apr 21 20:59:09 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b 1073741824" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b Apr 21 20:59:09 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe" returned: 0 in 0.502s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe Apr 21 20:59:09 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b" returned: 0 in 0.473s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37df9076-33db-4386-b132-3cf8380540ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bea7bc8-3af6-43fc-9163-9a4dcf1b7ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:10 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Volume volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b (4f1e66fd-db68-4b97-a6f5-e50d406a291b): created successfully Apr 21 20:59:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bea7bc8-3af6-43fc-9163-9a4dcf1b7ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:10 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Flow 'volume_create_manager' (2813c77c-c782-4e74-89c6-54b67d2b25d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:10 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9e98a9ac-22c7-4a48-966b-ae23207928f1 tempest-VolumesActionsTest-1754928333 None] Created volume successfully. Apr 21 20:59:10 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.50b7002c-9b2b-493f-9a0d-49483647ffbe" returned: 0 in 0.458s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-50b7002c-9b2b-493f-9a0d-49483647ffbe" released by "_delete_snapshot" :: held 2.188s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" released by "delete_snapshot" :: held 2.198s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Created reservations ['409a2c77-5585-4f5c-8a92-b656f7625490', '1d18e722-6b97-4fe6-bb19-e7f541bc4e26', 'bad98039-e866-4e40-97ac-cf3555764f50', '057467e4-9339-4a7a-a0dc-5053d7f25d26'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:10 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Delete snapshot completed successfully. Apr 21 20:59:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-63a79cd6-d05c-46e7-8a84-c83d62ac8ea6 tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-50b7002c-9b2b-493f-9a0d-49483647ffbe-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-2fb2911b-2725-43fe-8d52-c1c731950028-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-2fb2911b-2725-43fe-8d52-c1c731950028-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-quobyte-2fb2911b-2725-43fe-8d52-c1c731950028" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-2fb2911b-2725-43fe-8d52-c1c731950028" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Deleting offline snapshot 2fb2911b-2725-43fe-8d52-c1c731950028 of volume 943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] snapshot_file for this snap is: volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cad772d-d268-467e-93cb-2b5bce5f83b6]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:11 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 Apr 21 20:59:11 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "cinder-4f1e66fd-db68-4b97-a6f5-e50d406a291b-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-4f1e66fd-db68-4b97-a6f5-e50d406a291b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "cinder-quobyte-4f1e66fd-db68-4b97-a6f5-e50d406a291b" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-quobyte-4f1e66fd-db68-4b97-a6f5-e50d406a291b" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64a2407-933f-4db0-aad9-8f2ca6d99118]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:11 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b Apr 21 20:59:11 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:11 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028" returned: 0 in 0.564s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943aa576-8382-439b-93c2-b1e15883399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df43246-3ccd-495a-ad1e-d07aa0b1fb82]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:11 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d Apr 21 20:59:11 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b" returned: 0 in 0.523s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b Apr 21 20:59:12 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d" returned: 0 in 0.528s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 Apr 21 20:59:12 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4f1e66fd-db68-4b97-a6f5-e50d406a291b" returned: 0 in 0.414s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-quobyte-4f1e66fd-db68-4b97-a6f5-e50d406a291b" released by "delete_volume" :: held 0.963s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Created reservations ['9665a59d-267e-4312-b0a6-fa9fc45531ea', '014d2163-c667-4314-8e04-f9480d9f6184', '0f81a788-41c9-447e-9d4d-2394c6d6c3d8', '8d8f64b5-cc28-4751-baa8-4a44f723c072'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:12 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:12 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028" returned: 0 in 0.527s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:12 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028 Apr 21 20:59:12 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:13 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.484s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:13 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Deleted volume successfully. Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-294f7c0c-e61c-4675-96f5-9de590fbbda1 tempest-VolumesActionsTest-1754928333 None] Lock "cinder-4f1e66fd-db68-4b97-a6f5-e50d406a291b-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:13 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d.2fb2911b-2725-43fe-8d52-c1c731950028" returned: 0 in 0.520s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-2fb2911b-2725-43fe-8d52-c1c731950028" released by "_delete_snapshot" :: held 2.203s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" released by "delete_snapshot" :: held 2.216s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Created reservations ['afa41f3e-2157-4cfa-9280-f8f08c826643', 'b8df1277-3047-4f70-9abf-bae2e984dc81', 'cf6a51c2-4b73-407f-8054-11dc8eb2f830', 'a6fcf3bd-9607-4e0a-963b-c9177e37670a'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:13 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Delete snapshot completed successfully. Apr 21 20:59:13 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b7184e23-62a7-4cbc-9553-85e753247c0b tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-2fb2911b-2725-43fe-8d52-c1c731950028-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-943aa576-8382-439b-93c2-b1e15883399d-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-943aa576-8382-439b-93c2-b1e15883399d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:14 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec4a9a3-a74e-4f91-b9a1-7a652a0733fc]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:14 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d Apr 21 20:59:14 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d" returned: 0 in 0.550s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d Apr 21 20:59:15 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-943aa576-8382-439b-93c2-b1e15883399d" returned: 0 in 0.479s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-quobyte-943aa576-8382-439b-93c2-b1e15883399d" released by "delete_volume" :: held 1.067s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Created reservations ['9206f797-7b71-48eb-a5a9-7dede49faebb', '3fb71d86-f6f3-44fc-8402-426ab8339568', '8330a115-2c37-4a2b-9b0d-fbb1d59305ee', '5af7f1cd-63d7-411f-b485-f738da24f122'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:15 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:16 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.435s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:16 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:16 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Deleted volume successfully. Apr 21 20:59:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bc10ade5-a6bb-465b-ba7a-ac8690cd846a tempest-VolumesSnapshotListTestJSON-978107127 None] Lock "cinder-943aa576-8382-439b-93c2-b1e15883399d-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (43f8f458-3ba1-45a4-9e8a-aeac7b102253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c75131-cb67-47f2-9c4e-d1e6fbf28aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c75131-cb67-47f2-9c4e-d1e6fbf28aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239705915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:19Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfa5b06-d468-4bde-87f2-0b824ac31c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfa5b06-d468-4bde-87f2-0b824ac31c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5c21f3-86c6-4a77-91c0-a2610b75ace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5c21f3-86c6-4a77-91c0-a2610b75ace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5', 'volume_name': 'volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cfb657-6074-42ab-966f-bd4440bf7e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cfb657-6074-42ab-966f-bd4440bf7e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da84cd5-75fe-436b-a8b0-346124833c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:18 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5', 'volume_size': 1} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239705915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:19Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Creating volume ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:18 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:18 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 1073741824 Apr 21 20:59:18 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:19 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 1073741824" returned: 0 in 0.529s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:19 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 Apr 21 20:59:19 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:19 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5" returned: 0 in 0.529s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da84cd5-75fe-436b-a8b0-346124833c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedcdd6c-c770-41e8-b807-b44838e51404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:19 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 (ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5): created successfully Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedcdd6c-c770-41e8-b807-b44838e51404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (43f8f458-3ba1-45a4-9e8a-aeac7b102253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:19 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-074d9c9a-8594-4c94-b72b-97410dae8b2e tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created volume successfully. Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Flow 'volume_create_manager' (f09d0ba3-303d-48f1-826d-c6b8c76a4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd4ed70-94de-4889-bebf-32ec75211973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd4ed70-94de-4889-bebf-32ec75211973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1742694795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05bf439-a222-43c0-a8da-a77823da5798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20397e75c89e4f2b8c668d47c8f541b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:20Z,use_quota=True,user_id='342094a38384418d9cdbc7e992efc9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ec76af-9c5f-4951-a30e-b5b0716e09d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ec76af-9c5f-4951-a30e-b5b0716e09d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30293ccc-f8f7-48fd-9399-366b7a496f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30293ccc-f8f7-48fd-9399-366b7a496f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05bf439-a222-43c0-a8da-a77823da5798', 'volume_name': 'volume-a05bf439-a222-43c0-a8da-a77823da5798', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b7dcd4-c6a1-47f3-b49e-002c628463d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b7dcd4-c6a1-47f3-b49e-002c628463d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe9c0b8-4a6d-4656-8ca6-2d16431c6aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Volume a05bf439-a222-43c0-a8da-a77823da5798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05bf439-a222-43c0-a8da-a77823da5798', 'volume_size': 1} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1742694795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05bf439-a222-43c0-a8da-a77823da5798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20397e75c89e4f2b8c668d47c8f541b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:20Z,use_quota=True,user_id='342094a38384418d9cdbc7e992efc9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Creating volume a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:20 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:20 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 1073741824 Apr 21 20:59:20 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (f55f6a33-dd33-4275-92fe-5420fe029e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b0b29f-ceb8-4276-b682-3049415d8472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b0b29f-ceb8-4276-b682-3049415d8472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1058937356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591697df-8494-4ebc-b3f3-03b311a17314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295cc747-087f-4b0b-b6b6-da93dbd52a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295cc747-087f-4b0b-b6b6-da93dbd52a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed12168-d3dc-41e3-ac3c-83280195a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed12168-d3dc-41e3-ac3c-83280195a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '591697df-8494-4ebc-b3f3-03b311a17314', 'volume_name': 'volume-591697df-8494-4ebc-b3f3-03b311a17314', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a94ac32-d2d0-44b0-ad6b-d244a832c083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a94ac32-d2d0-44b0-ad6b-d244a832c083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f60fec-cb71-4606-b78a-9d39bc6818f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume 591697df-8494-4ebc-b3f3-03b311a17314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-591697df-8494-4ebc-b3f3-03b311a17314', 'volume_size': 1} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 1073741824" returned: 0 in 0.601s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:21 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 Apr 21 20:59:21 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (2cd594f0-602b-4c60-a8ec-62d1ee2e4482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ea14e2-8aa6-4e7e-8386-f625c3c8f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ea14e2-8aa6-4e7e-8386-f625c3c8f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1207087355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58671325-5bb2-4bce-bce7-7830582917a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30c6db4-7614-4fd2-a2b8-4f5ec78f9138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30c6db4-7614-4fd2-a2b8-4f5ec78f9138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2ff86a-8a27-49f5-a14c-a8972b8d8e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2ff86a-8a27-49f5-a14c-a8972b8d8e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58671325-5bb2-4bce-bce7-7830582917a4', 'volume_name': 'volume-58671325-5bb2-4bce-bce7-7830582917a4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b00cf1-4bb5-4978-a249-5827b06b20ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b00cf1-4bb5-4978-a249-5827b06b20ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e2543b-2d89-4e2a-b808-9771f794486f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume 58671325-5bb2-4bce-bce7-7830582917a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58671325-5bb2-4bce-bce7-7830582917a4', 'volume_size': 1} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (5c655e33-8411-47ec-9003-8f318fd79097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63b2ae4-51ba-4c8d-993a-9693ec8604f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63b2ae4-51ba-4c8d-993a-9693ec8604f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-427911913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954110cd-5aec-4e9d-9ebb-5d228c1a4b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eacee2-5483-4a34-8cba-14e580fa2c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eacee2-5483-4a34-8cba-14e580fa2c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530a5bdc-7ce4-4a4e-9ef4-226a45cc95db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (530a5bdc-7ce4-4a4e-9ef4-226a45cc95db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954110cd-5aec-4e9d-9ebb-5d228c1a4b30', 'volume_name': 'volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59dd2a6-4fe3-4e14-a405-9cc485f52711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59dd2a6-4fe3-4e14-a405-9cc485f52711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520fe0db-b1ce-44b5-9b1f-f4ac6e8bb257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume 954110cd-5aec-4e9d-9ebb-5d228c1a4b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30', 'volume_size': 1} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798" returned: 0 in 0.526s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1058937356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=591697df-8494-4ebc-b3f3-03b311a17314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Creating volume 591697df-8494-4ebc-b3f3-03b311a17314 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe9c0b8-4a6d-4656-8ca6-2d16431c6aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05bf439-a222-43c0-a8da-a77823da5798', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 1073741824 Apr 21 20:59:21 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87961b2a-3ee6-4188-88ee-b8aad2001e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Volume volume-a05bf439-a222-43c0-a8da-a77823da5798 (a05bf439-a222-43c0-a8da-a77823da5798): created successfully Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87961b2a-3ee6-4188-88ee-b8aad2001e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Flow 'volume_create_manager' (f09d0ba3-303d-48f1-826d-c6b8c76a4369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-10b7165c-e635-401c-a852-5ce781529aed tempest-SnapshotMetadataTestJSON-77458699 None] Created volume successfully. Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (a611ee6e-0200-4c7a-b6cf-0c6633aed60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00505665-66b2-47fd-aa63-4208cecd7171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00505665-66b2-47fd-aa63-4208cecd7171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814613372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada77f83-2c38-4eb1-8970-d2d7a569d7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:22Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934a3d03-8e08-4bb3-92dc-bb6c612a24b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934a3d03-8e08-4bb3-92dc-bb6c612a24b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd3fa01-aa8a-46db-89ee-509111cd77a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd3fa01-aa8a-46db-89ee-509111cd77a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada77f83-2c38-4eb1-8970-d2d7a569d7d2', 'volume_name': 'volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378631b1-7b81-4efa-9bf5-064796f223cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378631b1-7b81-4efa-9bf5-064796f223cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfa7147-5541-4c74-a80e-9834fc91ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume ada77f83-2c38-4eb1-8970-d2d7a569d7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2', 'volume_size': 1} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (84ccaed0-4a33-43e8-a9fc-817a596a4d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04369041-6e4a-4d2a-a91d-1cf3e99c7384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04369041-6e4a-4d2a-a91d-1cf3e99c7384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1930031485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eed901-02a9-419a-9829-4689c70d8fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:22Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a8de57-d86c-446e-94aa-e1944e4f1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a8de57-d86c-446e-94aa-e1944e4f1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca6b031-4ebb-45d0-900e-13169d9bab56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca6b031-4ebb-45d0-900e-13169d9bab56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27eed901-02a9-419a-9829-4689c70d8fda', 'volume_name': 'volume-27eed901-02a9-419a-9829-4689c70d8fda', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dee1b97-d652-459c-8dd2-ced512ed190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dee1b97-d652-459c-8dd2-ced512ed190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316aa873-c59d-429b-a750-81af1743cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume 27eed901-02a9-419a-9829-4689c70d8fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27eed901-02a9-419a-9829-4689c70d8fda', 'volume_size': 1} Apr 21 20:59:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:22 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 1073741824" returned: 0 in 0.549s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:22 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 Apr 21 20:59:22 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:22 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314" returned: 0 in 0.487s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1207087355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58671325-5bb2-4bce-bce7-7830582917a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Creating volume 58671325-5bb2-4bce-bce7-7830582917a4 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:22 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:22 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 1073741824 Apr 21 20:59:22 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f60fec-cb71-4606-b78a-9d39bc6818f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-591697df-8494-4ebc-b3f3-03b311a17314', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebbe7d6-4412-4fdc-ad23-54d20124dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:22 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume volume-591697df-8494-4ebc-b3f3-03b311a17314 (591697df-8494-4ebc-b3f3-03b311a17314): created successfully Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebbe7d6-4412-4fdc-ad23-54d20124dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (f55f6a33-dd33-4275-92fe-5420fe029e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:22 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9c0368d0-55d4-43df-ad17-a584b496e909 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created volume successfully. Apr 21 20:59:23 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 1073741824" returned: 0 in 0.512s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:23 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 Apr 21 20:59:23 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:23 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4" returned: 0 in 0.490s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.216s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-427911913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954110cd-5aec-4e9d-9ebb-5d228c1a4b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:21Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Creating volume 954110cd-5aec-4e9d-9ebb-5d228c1a4b30 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:23 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:23 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 1073741824 Apr 21 20:59:23 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e2543b-2d89-4e2a-b808-9771f794486f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58671325-5bb2-4bce-bce7-7830582917a4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bde070-fdc5-45fe-8ff5-8bc7f8cab2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:23 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume volume-58671325-5bb2-4bce-bce7-7830582917a4 (58671325-5bb2-4bce-bce7-7830582917a4): created successfully Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bde070-fdc5-45fe-8ff5-8bc7f8cab2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (2cd594f0-602b-4c60-a8ec-62d1ee2e4482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-92043eff-d674-4da4-999b-51c6134070da tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created volume successfully. Apr 21 20:59:24 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 1073741824" returned: 0 in 0.498s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:24 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 Apr 21 20:59:24 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:24 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30" returned: 0 in 0.420s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.895s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-814613372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada77f83-2c38-4eb1-8970-d2d7a569d7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:22Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Creating volume ada77f83-2c38-4eb1-8970-d2d7a569d7d2 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:24 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520fe0db-b1ce-44b5-9b1f-f4ac6e8bb257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:24 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 1073741824 Apr 21 20:59:24 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f0554d-2d22-4f5d-bd6b-81d05d549b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:24 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 (954110cd-5aec-4e9d-9ebb-5d228c1a4b30): created successfully Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f0554d-2d22-4f5d-bd6b-81d05d549b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (5c655e33-8411-47ec-9003-8f318fd79097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:24 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-99debde8-82ca-42ed-9f0b-a51fa9de4e0c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created volume successfully. Apr 21 20:59:25 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 1073741824" returned: 0 in 0.503s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:25 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 Apr 21 20:59:25 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:25 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2" returned: 0 in 0.402s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.658s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1930031485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eed901-02a9-419a-9829-4689c70d8fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a82a35ef1c4228b94ca3c362f9cbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:22Z,use_quota=True,user_id='d206b1e77b9041a4b0c4b0f89e9a735f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Creating volume 27eed901-02a9-419a-9829-4689c70d8fda {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:25 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dfa7147-5541-4c74-a80e-9834fc91ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:25 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda 1073741824 Apr 21 20:59:25 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db90742f-b5d6-4df7-905a-03bbea30e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:25 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 (ada77f83-2c38-4eb1-8970-d2d7a569d7d2): created successfully Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db90742f-b5d6-4df7-905a-03bbea30e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (a611ee6e-0200-4c7a-b6cf-0c6633aed60c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:25 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1ecadcbc-9918-4085-b408-87db50a7de08 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created volume successfully. Apr 21 20:59:26 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda 1073741824" returned: 0 in 0.493s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:26 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda Apr 21 20:59:26 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:26 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda" returned: 0 in 0.424s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.838s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316aa873-c59d-429b-a750-81af1743cf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27eed901-02a9-419a-9829-4689c70d8fda', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b71571-df84-451d-bf61-6d8dfc252d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Creating offline snapshot c4e10e24-6f45-45a7-a0f1-39821ca5770c of volume a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:26 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Volume volume-27eed901-02a9-419a-9829-4689c70d8fda (27eed901-02a9-419a-9829-4689c70d8fda): created successfully Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b71571-df84-451d-bf61-6d8dfc252d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Flow 'volume_create_manager' (84ccaed0-4a33-43e8-a9fc-817a596a4d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d083c1-b48d-4f09-80c2-c06e6f9d41a5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:26 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-72c08ac9-83b8-4f07-9440-b80b9fa985f4 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created volume successfully. Apr 21 20:59:26 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 Apr 21 20:59:26 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:27 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798" returned: 0 in 0.520s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:27 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c 1G Apr 21 20:59:27 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-27eed901-02a9-419a-9829-4689c70d8fda-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-27eed901-02a9-419a-9829-4689c70d8fda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-quobyte-27eed901-02a9-419a-9829-4689c70d8fda" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-27eed901-02a9-419a-9829-4689c70d8fda" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda93611-5935-4e71-9f8e-0b255af44a00]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:27 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda Apr 21 20:59:27 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:27 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c 1G" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05bf439-a222-43c0-a8da-a77823da5798 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:27 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05bf439-a222-43c0-a8da-a77823da5798 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c Apr 21 20:59:27 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda" returned: 0 in 0.496s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda Apr 21 20:59:28 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a05bf439-a222-43c0-a8da-a77823da5798 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c" returned: 0 in 0.474s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c is being set with open permissions: ugo+rw Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c Apr 21 20:59:28 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-27eed901-02a9-419a-9829-4689c70d8fda" returned: 0 in 0.414s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-27eed901-02a9-419a-9829-4689c70d8fda" released by "delete_volume" :: held 0.934s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created reservations ['c0a2dd23-9911-4375-ae20-8c35c0636a36', 'ed7d0b43-cab5-47dc-ba04-305ee3b445b7', '995f95fd-8f28-4751-843d-c07ab3701ce8', 'e18e80f0-4b35-44bb-abea-5a28900ae0f3'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:28 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-ada77f83-2c38-4eb1-8970-d2d7a569d7d2-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-ada77f83-2c38-4eb1-8970-d2d7a569d7d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-quobyte-ada77f83-2c38-4eb1-8970-d2d7a569d7d2" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-ada77f83-2c38-4eb1-8970-d2d7a569d7d2" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:28 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[577dc406-6107-4483-890e-2702b4fa222a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c" returned: 0 in 0.497s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.info Apr 21 20:59:28 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 Apr 21 20:59:28 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.443s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Deleted volume successfully. Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bb8c73c0-768a-4dcd-bdbd-b0eaf2f13777 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-27eed901-02a9-419a-9829-4689c70d8fda-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:29 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.info" returned: 0 in 0.439s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.info is being set with open permissions: ugo+rw Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:29 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.info Apr 21 20:59:29 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:29 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2" returned: 0 in 0.532s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:29 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2 Apr 21 20:59:29 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:29 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.info" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:29 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-33b5a8bf-8835-4b40-9f31-0e74b6001461 tempest-SnapshotMetadataTestJSON-77458699 None] Create snapshot completed successfully Apr 21 20:59:29 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ada77f83-2c38-4eb1-8970-d2d7a569d7d2" returned: 0 in 0.444s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-ada77f83-2c38-4eb1-8970-d2d7a569d7d2" released by "delete_volume" :: held 1.003s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created reservations ['2810e3c3-459c-4a6a-8081-b372915d7728', '04099b81-ff14-408e-83f9-bfc74df925f1', '8c713700-6514-4c6f-9576-52fa850854de', '9d06a4b2-6262-470b-9d1a-54c7fe61b19b'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:29 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:29 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.487s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:30 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Deleted volume successfully. Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b094e082-3937-408a-b19f-f7e3615a279c tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-ada77f83-2c38-4eb1-8970-d2d7a569d7d2-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "cinder-c4e10e24-6f45-45a7-a0f1-39821ca5770c-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-c4e10e24-6f45-45a7-a0f1-39821ca5770c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "cinder-quobyte-a05bf439-a222-43c0-a8da-a77823da5798" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-quobyte-a05bf439-a222-43c0-a8da-a77823da5798" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "cinder-quobyte-c4e10e24-6f45-45a7-a0f1-39821ca5770c" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-quobyte-c4e10e24-6f45-45a7-a0f1-39821ca5770c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Deleting offline snapshot c4e10e24-6f45-45a7-a0f1-39821ca5770c of volume a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] snapshot_file for this snap is: volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c03a51-ef1a-4d07-907f-4ca7063b45ca]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c Apr 21 20:59:30 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-954110cd-5aec-4e9d-9ebb-5d228c1a4b30-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-954110cd-5aec-4e9d-9ebb-5d228c1a4b30-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-quobyte-954110cd-5aec-4e9d-9ebb-5d228c1a4b30" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-954110cd-5aec-4e9d-9ebb-5d228c1a4b30" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e9526-24a4-4455-8007-404e87555b62]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 Apr 21 20:59:30 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c" returned: 0 in 0.493s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a05bf439-a222-43c0-a8da-a77823da5798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[80062232-82e1-4a6a-8109-354bf8da942c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 Apr 21 20:59:31 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30" returned: 0 in 0.469s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30 Apr 21 20:59:31 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798" returned: 0 in 0.527s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c Apr 21 20:59:31 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-954110cd-5aec-4e9d-9ebb-5d228c1a4b30" returned: 0 in 0.409s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-954110cd-5aec-4e9d-9ebb-5d228c1a4b30" released by "delete_volume" :: held 0.908s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created reservations ['491eaeba-7796-4d44-96f3-4eddff098da6', '381a51d5-d2d1-4deb-87b5-0a9baaff546e', '0ee9973e-6196-4972-8e2f-e4dfcd1d9546', 'a25aa8c4-5812-45c9-86fb-154a3dbe9ede'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:31 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-58671325-5bb2-4bce-bce7-7830582917a4-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-58671325-5bb2-4bce-bce7-7830582917a4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-quobyte-58671325-5bb2-4bce-bce7-7830582917a4" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-58671325-5bb2-4bce-bce7-7830582917a4" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37147a1-5d9a-4cb9-95c1-9222cdf27b39]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:32 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c" returned: 0 in 0.486s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:32 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 Apr 21 20:59:32 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:32 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c Apr 21 20:59:32 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:32 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.481s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:32 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Deleted volume successfully. Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fd3a0e76-0604-42e7-92b8-5c4a580ff788 tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-954110cd-5aec-4e9d-9ebb-5d228c1a4b30-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:32 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4" returned: 0 in 0.483s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:32 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4 Apr 21 20:59:32 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:32 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798.c4e10e24-6f45-45a7-a0f1-39821ca5770c" returned: 0 in 0.466s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-quobyte-c4e10e24-6f45-45a7-a0f1-39821ca5770c" released by "_delete_snapshot" :: held 2.030s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-quobyte-a05bf439-a222-43c0-a8da-a77823da5798" released by "delete_snapshot" :: held 2.043s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Created reservations ['c12d40bb-734d-41c4-87b6-6b75861bbd57', '91f8a190-6a6a-49d4-b274-915335819acf', '27779266-2eb0-4a07-9f1a-fd45bc61b419', '853b1915-7dfc-42ec-83e6-6867a72ba5e1'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:32 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Delete snapshot completed successfully. Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c0a6817b-3c1c-47de-80f3-43b46a039a3c tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-c4e10e24-6f45-45a7-a0f1-39821ca5770c-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:32 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-58671325-5bb2-4bce-bce7-7830582917a4" returned: 0 in 0.447s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-58671325-5bb2-4bce-bce7-7830582917a4" released by "delete_volume" :: held 0.952s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created reservations ['bf572aec-32fb-4af9-8071-a9225b8265be', '34c728ca-ea9e-4c97-af8c-1ccb11e68095', '42c7d8bd-8f64-4347-ad55-a2272d090f46', '51563450-3edd-4986-aff9-8d07a0816f9c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:33 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:33 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-591697df-8494-4ebc-b3f3-03b311a17314-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-591697df-8494-4ebc-b3f3-03b311a17314-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-quobyte-591697df-8494-4ebc-b3f3-03b311a17314" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-591697df-8494-4ebc-b3f3-03b311a17314" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[f775761e-7e72-432d-a1e4-c415b4d00df2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:33 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 Apr 21 20:59:33 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:33 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.470s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:33 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Deleted volume successfully. Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fc1b62cb-43f8-46d9-9c68-18d423c9011f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-58671325-5bb2-4bce-bce7-7830582917a4-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "cinder-a05bf439-a222-43c0-a8da-a77823da5798-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-a05bf439-a222-43c0-a8da-a77823da5798-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:33 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "cinder-quobyte-a05bf439-a222-43c0-a8da-a77823da5798" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314" returned: 0 in 0.617s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-quobyte-a05bf439-a222-43c0-a8da-a77823da5798" acquired by "delete_volume" :: waited 0.023s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:33 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314 Apr 21 20:59:33 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9b6502-466b-485f-b099-af10b9f92485]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:33 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 Apr 21 20:59:33 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:34 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-591697df-8494-4ebc-b3f3-03b311a17314" returned: 0 in 0.449s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-591697df-8494-4ebc-b3f3-03b311a17314" released by "delete_volume" :: held 1.088s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created reservations ['9b508586-7820-465d-9b9a-cd87bf6e192b', '1aaa28b9-29b8-4fe5-a197-0fe09f203a59', 'f746cc75-806a-4907-ab8d-82f45012853a', 'c38caff9-ff28-4d56-8210-88a3a48d513e'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:34 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:34 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798" returned: 0 in 0.544s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798 Apr 21 20:59:34 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:34 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.421s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:34 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Deleted volume successfully. Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15e696be-44d4-4360-853d-c4312d0b104f tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-591697df-8494-4ebc-b3f3-03b311a17314-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:34 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-a05bf439-a222-43c0-a8da-a77823da5798" returned: 0 in 0.453s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-quobyte-a05bf439-a222-43c0-a8da-a77823da5798" released by "delete_volume" :: held 1.029s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Created reservations ['604e11ee-5e03-4c73-8cb8-da70f659cc53', 'c959c4f6-1eb2-4ca5-b54e-761b3b72b17d', '23e94df1-0d35-41a6-8f8c-61f31e80fef1', 'f830bcdd-2544-4e51-91b1-70236b636ae3'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:34 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "cinder-quobyte-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ddb4bd-d380-401a-a080-2f2681e274b9]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:35 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.466s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:35 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Deleted volume successfully. Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-fb4da584-0868-46b6-85d9-b1f6872ff563 tempest-SnapshotMetadataTestJSON-77458699 None] Lock "cinder-a05bf439-a222-43c0-a8da-a77823da5798-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:35 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 Apr 21 20:59:35 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5" returned: 0 in 0.500s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:35 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5 Apr 21 20:59:35 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5" returned: 0 in 0.471s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-quobyte-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5" released by "delete_volume" :: held 1.005s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Created reservations ['f2380e81-7b26-4d78-92e0-65a0a81c57bb', '2f43d55b-881d-44ac-b7b2-1f8a4d75d22b', 'ce1f767e-2cea-4ffe-9013-639eca56298a', '5aa73e50-09a6-4198-94d3-f0c8a4b51a74'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:36 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:36 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.450s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:36 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Deleted volume successfully. Apr 21 20:59:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0e4ec77-d504-4f42-bad2-abc78d25262b tempest-CreateVolumesFromSourceVolumeTest-157006649 None] Lock "cinder-ae5ffde7-2c94-42cb-b41d-7ce874d9c3b5-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Flow 'volume_create_manager' (5f4d5005-98c9-4e54-a9b5-134abca7e41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d53ed08-d8e6-48e1-840a-697eecd8027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d53ed08-d8e6-48e1-840a-697eecd8027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1936631683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88c4591-444c-4c39-8fb4-3a629e588095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319ee59cd924601a1532282023be2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:38Z,use_quota=True,user_id='17db185513e14d24a1934cb019c2e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdf7d27-3cd3-47e1-b31b-136b15df0d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdf7d27-3cd3-47e1-b31b-136b15df0d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871a57e1-50ac-48c1-a039-ecfab19f64c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871a57e1-50ac-48c1-a039-ecfab19f64c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88c4591-444c-4c39-8fb4-3a629e588095', 'volume_name': 'volume-f88c4591-444c-4c39-8fb4-3a629e588095', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7376bd0-60f0-4ecf-98b6-386f49204b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7376bd0-60f0-4ecf-98b6-386f49204b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab66cc67-8452-45de-b262-9da1929b50d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:38 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Volume f88c4591-444c-4c39-8fb4-3a629e588095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88c4591-444c-4c39-8fb4-3a629e588095', 'volume_size': 1} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1936631683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88c4591-444c-4c39-8fb4-3a629e588095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a319ee59cd924601a1532282023be2e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:38Z,use_quota=True,user_id='17db185513e14d24a1934cb019c2e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Creating volume f88c4591-444c-4c39-8fb4-3a629e588095 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:38 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 1073741824 Apr 21 20:59:38 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:38 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 1073741824" returned: 0 in 0.484s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:38 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 Apr 21 20:59:38 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095" returned: 0 in 0.433s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab66cc67-8452-45de-b262-9da1929b50d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88c4591-444c-4c39-8fb4-3a629e588095', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85d3da2-94e6-4db4-9b70-5d63065dc85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:39 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Volume volume-f88c4591-444c-4c39-8fb4-3a629e588095 (f88c4591-444c-4c39-8fb4-3a629e588095): created successfully Apr 21 20:59:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85d3da2-94e6-4db4-9b70-5d63065dc85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Flow 'volume_create_manager' (5f4d5005-98c9-4e54-a9b5-134abca7e41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:39 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2c8e2a8e-471d-4ff7-933b-58fc2500216f tempest-AbsoluteLimitsTests-159996096 None] Created volume successfully. Apr 21 20:59:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Acquiring lock "cinder-f88c4591-444c-4c39-8fb4-3a629e588095-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Lock "cinder-f88c4591-444c-4c39-8fb4-3a629e588095-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Acquiring lock "cinder-quobyte-f88c4591-444c-4c39-8fb4-3a629e588095" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Lock "cinder-quobyte-f88c4591-444c-4c39-8fb4-3a629e588095" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:40 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e342bbd-81b1-4bad-8c3c-57f95fa01004]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:40 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 Apr 21 20:59:40 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095" returned: 0 in 0.457s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095 Apr 21 20:59:41 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:41 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f88c4591-444c-4c39-8fb4-3a629e588095" returned: 0 in 0.410s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Lock "cinder-quobyte-f88c4591-444c-4c39-8fb4-3a629e588095" released by "delete_volume" :: held 0.891s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Created reservations ['cc74a470-1786-4e2f-bcdf-f3c6cf50a40b', '7602b14c-e63d-4b49-a49c-b7d510b4924e', 'd0ba68fc-f966-4b77-ae4a-425ce80799c5', '47f13019-8cb1-4b8c-8f8f-0610377953f7'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:41 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:41 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:42 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.483s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:42 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:42 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Deleted volume successfully. Apr 21 20:59:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-56cec297-244e-4861-8bb8-719217edd0f6 tempest-AbsoluteLimitsTests-159996096 None] Lock "cinder-f88c4591-444c-4c39-8fb4-3a629e588095-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Flow 'volume_create_manager' (6b24bebe-d56c-4969-8cf6-4c7784ab7faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ea886b-5b5e-451a-b60c-a1aef9c3282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ea886b-5b5e-451a-b60c-a1aef9c3282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1616014478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfc0cfc-d018-44f9-9309-97304c3de47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24089e5f25a3493eb7273b15674e45bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:45Z,use_quota=True,user_id='56ddf965f897442fb9bdaa97cc28071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6f1158-f23a-4097-bf7b-6113e9680cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6f1158-f23a-4097-bf7b-6113e9680cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807d1d8d-e291-4f6c-933f-6d431378c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807d1d8d-e291-4f6c-933f-6d431378c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfc0cfc-d018-44f9-9309-97304c3de47f', 'volume_name': 'volume-fbfc0cfc-d018-44f9-9309-97304c3de47f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7222f9c-09b7-4008-a513-95de5cc2dab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7222f9c-09b7-4008-a513-95de5cc2dab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f9253c-00a0-48da-989f-5dfd8874bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Volume fbfc0cfc-d018-44f9-9309-97304c3de47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfc0cfc-d018-44f9-9309-97304c3de47f', 'volume_size': 1} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1616014478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfc0cfc-d018-44f9-9309-97304c3de47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24089e5f25a3493eb7273b15674e45bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:45Z,use_quota=True,user_id='56ddf965f897442fb9bdaa97cc28071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Creating volume fbfc0cfc-d018-44f9-9309-97304c3de47f {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:45 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:45 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f 1073741824 Apr 21 20:59:45 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:45 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f 1073741824" returned: 0 in 0.518s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:45 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f Apr 21 20:59:45 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:46 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f" returned: 0 in 0.462s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f9253c-00a0-48da-989f-5dfd8874bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfc0cfc-d018-44f9-9309-97304c3de47f', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c96237c-86c0-44d2-8957-b8f594428459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Volume volume-fbfc0cfc-d018-44f9-9309-97304c3de47f (fbfc0cfc-d018-44f9-9309-97304c3de47f): created successfully Apr 21 20:59:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c96237c-86c0-44d2-8957-b8f594428459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Flow 'volume_create_manager' (6b24bebe-d56c-4969-8cf6-4c7784ab7faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:46 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9e992634-14ce-4201-9915-3bb5009db948 tempest-VolumesTransfersV355Test-1904495616 None] Created volume successfully. Apr 21 20:59:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2988d3d0-bce8-42ff-8f29-50981e8ef17b tempest-VolumesTransfersV355Test-1248279114 None] Transfer volume completed successfully. Apr 21 20:59:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Acquiring lock "cinder-fbfc0cfc-d018-44f9-9309-97304c3de47f-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-fbfc0cfc-d018-44f9-9309-97304c3de47f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Acquiring lock "cinder-quobyte-fbfc0cfc-d018-44f9-9309-97304c3de47f" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-quobyte-fbfc0cfc-d018-44f9-9309-97304c3de47f" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:48 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a99ba4-1f9a-4d1c-9fc0-edaf735e77c7]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f Apr 21 20:59:48 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f" returned: 0 in 0.502s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f Apr 21 20:59:49 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fbfc0cfc-d018-44f9-9309-97304c3de47f" returned: 0 in 0.465s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-quobyte-fbfc0cfc-d018-44f9-9309-97304c3de47f" released by "delete_volume" :: held 0.991s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Created reservations ['a78611cc-79f1-445c-8c0f-4bfb6fb64613', '515724d8-340b-4e59-93a0-1d3e0875ad50', '07db943e-7983-4393-b807-81c741ec607e', 'e2997a73-757c-4b9d-99fc-b79404aaccab'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:49 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Flow 'volume_create_manager' (66bc898e-ed7a-48fd-a804-ff9c0c709d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f56146-a635-44f2-a1f8-80063239bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f56146-a635-44f2-a1f8-80063239bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2097640651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c521bfbd-37be-4dca-bc63-f74a6cc11571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24089e5f25a3493eb7273b15674e45bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:50Z,use_quota=True,user_id='56ddf965f897442fb9bdaa97cc28071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ec0f61-ce81-48e1-a628-948c375e590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ec0f61-ce81-48e1-a628-948c375e590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517c9404-6694-403d-9d34-dade758c8e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517c9404-6694-403d-9d34-dade758c8e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c521bfbd-37be-4dca-bc63-f74a6cc11571', 'volume_name': 'volume-c521bfbd-37be-4dca-bc63-f74a6cc11571', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1907f0e-cb67-48db-b21e-8c840f250947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1907f0e-cb67-48db-b21e-8c840f250947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6482dc57-dc44-43dd-91f9-1c51290429d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Volume c521bfbd-37be-4dca-bc63-f74a6cc11571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c521bfbd-37be-4dca-bc63-f74a6cc11571', 'volume_size': 1} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2097640651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c521bfbd-37be-4dca-bc63-f74a6cc11571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24089e5f25a3493eb7273b15674e45bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:50Z,use_quota=True,user_id='56ddf965f897442fb9bdaa97cc28071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Creating volume c521bfbd-37be-4dca-bc63-f74a6cc11571 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:49 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 20:59:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 1073741824 Apr 21 20:59:49 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.494s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:50 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Deleted volume successfully. Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-90f38155-d4ff-49f8-964d-2c3c571bae17 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-fbfc0cfc-d018-44f9-9309-97304c3de47f-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:50 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 1073741824" returned: 0 in 0.514s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 Apr 21 20:59:50 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571" returned: 0 in 0.464s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6482dc57-dc44-43dd-91f9-1c51290429d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c521bfbd-37be-4dca-bc63-f74a6cc11571', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f059171a-749f-4e6c-9aac-0a2ffa90abb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Volume volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 (c521bfbd-37be-4dca-bc63-f74a6cc11571): created successfully Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f059171a-749f-4e6c-9aac-0a2ffa90abb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Flow 'volume_create_manager' (66bc898e-ed7a-48fd-a804-ff9c0c709d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:50 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d80479d9-5fb2-469a-9f00-bde7e7a479c0 tempest-VolumesTransfersV355Test-1904495616 None] Created volume successfully. Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Acquiring lock "cinder-c521bfbd-37be-4dca-bc63-f74a6cc11571-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-c521bfbd-37be-4dca-bc63-f74a6cc11571-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Acquiring lock "cinder-quobyte-c521bfbd-37be-4dca-bc63-f74a6cc11571" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-quobyte-c521bfbd-37be-4dca-bc63-f74a6cc11571" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bf70b5-dd12-4f75-b0bf-6b33b371c0a6]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 Apr 21 20:59:52 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:52 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571" returned: 0 in 0.494s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571 Apr 21 20:59:52 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-c521bfbd-37be-4dca-bc63-f74a6cc11571" returned: 0 in 0.450s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-quobyte-c521bfbd-37be-4dca-bc63-f74a6cc11571" released by "delete_volume" :: held 0.969s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Created reservations ['e006ac5f-7d54-496c-b84f-dd5e786fdd3b', 'a41a76fc-2634-4c58-b908-7ad00843f101', 'bb279a5e-9887-420e-8f2e-4ea81a6b16a7', '1c12069c-32c9-4dd6-929a-04dffab994cc'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 20:59:53 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.501s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Deleted volume successfully. Apr 21 20:59:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-2b28158c-4627-4d95-85e7-5c9dd4b0c772 tempest-VolumesTransfersV355Test-421118422 None] Lock "cinder-c521bfbd-37be-4dca-bc63-f74a6cc11571-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:00:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:00:02 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.532s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:03 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:DELETE=13,cinder:SELECT=122,cinder:UPDATE=196,cinder:INSERT=49 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:03 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:UPDATE=154,cinder:SELECT=123,cinder:DELETE=17,cinder:INSERT=37 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Flow 'volume_create_manager' (15415403-44c1-4934-a1f0-2bf47addd1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9be46c7-7e07-4907-a092-13871cd06b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9be46c7-7e07-4907-a092-13871cd06b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600760268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe5d87a-4e92-4689-a075-23350f15f926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2862f9ff36ab4b388be3db96687027f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:04Z,use_quota=True,user_id='f9f473e866934c58b77731f74a1e4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359b2a33-50b9-41cf-b036-6bfa32b6f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359b2a33-50b9-41cf-b036-6bfa32b6f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c22884-5dac-4300-86c1-2d00626f5c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c22884-5dac-4300-86c1-2d00626f5c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe5d87a-4e92-4689-a075-23350f15f926', 'volume_name': 'volume-dfe5d87a-4e92-4689-a075-23350f15f926', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3731ec0-a7e2-4f5b-8e8b-8d252bb38593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3731ec0-a7e2-4f5b-8e8b-8d252bb38593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f1ceb6-99d8-4a5f-8221-42b56d40dee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:04 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Volume dfe5d87a-4e92-4689-a075-23350f15f926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe5d87a-4e92-4689-a075-23350f15f926', 'volume_size': 1} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600760268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe5d87a-4e92-4689-a075-23350f15f926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2862f9ff36ab4b388be3db96687027f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:04Z,use_quota=True,user_id='f9f473e866934c58b77731f74a1e4872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Creating volume dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:04 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 1073741824 Apr 21 21:00:04 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 1073741824" returned: 0 in 0.509s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:00:04 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.443s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f1ceb6-99d8-4a5f-8221-42b56d40dee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe5d87a-4e92-4689-a075-23350f15f926', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc53c17-1a83-42cb-9b9f-da90a62b8e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:05 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Volume volume-dfe5d87a-4e92-4689-a075-23350f15f926 (dfe5d87a-4e92-4689-a075-23350f15f926): created successfully Apr 21 21:00:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc53c17-1a83-42cb-9b9f-da90a62b8e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:05 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Flow 'volume_create_manager' (15415403-44c1-4934-a1f0-2bf47addd1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:05 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-492e0daf-7fe2-4db3-8c80-6dd0848b1d53 tempest-VolumesActionsTest-1955380404 None] Created volume successfully. Apr 21 21:00:15 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:INSERT=1 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:15 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50fa844f-dbff-4004-8229-99b6dd502aa8 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926" by "attach_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:19 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50fa844f-dbff-4004-8229-99b6dd502aa8 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926" acquired by "attach_volume" :: waited 0.057s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:20 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-50fa844f-dbff-4004-8229-99b6dd502aa8 tempest-VolumesActionsTest-1955380404 None] Attaching volume dfe5d87a-4e92-4689-a075-23350f15f926 to instance 1271b603-6711-417d-b6be-aa354eb85d0a at mountpoint /dev/vdb on host None. Apr 21 21:00:20 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-50fa844f-dbff-4004-8229-99b6dd502aa8 tempest-VolumesActionsTest-1955380404 None] Attach volume completed successfully. Apr 21 21:00:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50fa844f-dbff-4004-8229-99b6dd502aa8 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926" released by "attach_volume" :: held 0.063s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0ea4185-b37e-4ded-ab70-b63b5a4c5119 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-detach_volume" by "detach_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0ea4185-b37e-4ded-ab70-b63b5a4c5119 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:20 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e0ea4185-b37e-4ded-ab70-b63b5a4c5119 tempest-VolumesActionsTest-1955380404 None] Detaching volume dfe5d87a-4e92-4689-a075-23350f15f926 from instance 1271b603-6711-417d-b6be-aa354eb85d0a. Apr 21 21:00:20 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e0ea4185-b37e-4ded-ab70-b63b5a4c5119 tempest-VolumesActionsTest-1955380404 None] Detach volume completed successfully. Apr 21 21:00:20 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e0ea4185-b37e-4ded-ab70-b63b5a4c5119 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-detach_volume" released by "detach_volume" :: held 0.035s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:30 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:30 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:INSERT=1,cinder:SELECT=9,cinder:UPDATE=3 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d9a30973-4671-437a-bfd2-894f5294d935 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926" by "attach_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d9a30973-4671-437a-bfd2-894f5294d935 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926" acquired by "attach_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:40 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d9a30973-4671-437a-bfd2-894f5294d935 tempest-VolumesActionsTest-1955380404 None] Attaching volume dfe5d87a-4e92-4689-a075-23350f15f926 to instance c194fca4-0e3b-4701-ad5c-0767b4a4f1e9 at mountpoint /dev/vdb on host None. Apr 21 21:00:40 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d9a30973-4671-437a-bfd2-894f5294d935 tempest-VolumesActionsTest-1955380404 None] Attach volume completed successfully. Apr 21 21:00:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d9a30973-4671-437a-bfd2-894f5294d935 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926" released by "attach_volume" :: held 0.071s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:41 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-71e9de6b-8965-470e-ab7a-3e871dbe5589 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-detach_volume" by "detach_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:41 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-71e9de6b-8965-470e-ab7a-3e871dbe5589 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:41 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-71e9de6b-8965-470e-ab7a-3e871dbe5589 tempest-VolumesActionsTest-1955380404 None] Detaching volume dfe5d87a-4e92-4689-a075-23350f15f926 from instance c194fca4-0e3b-4701-ad5c-0767b4a4f1e9. Apr 21 21:00:41 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-71e9de6b-8965-470e-ab7a-3e871dbe5589 tempest-VolumesActionsTest-1955380404 None] Detach volume completed successfully. Apr 21 21:00:41 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-71e9de6b-8965-470e-ab7a-3e871dbe5589 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-detach_volume" released by "detach_volume" :: held 0.045s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:49 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c4104d-715d-4ad7-ab26-7b82e88a3191]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:49 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:00:49 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:49 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.472s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:49 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[09774b02-1c94-490e-b83b-8ff210ead6d8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:49 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:00:49 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:50 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.489s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.8517edc0-1328-45f7-9957-985767ac5d44rsvhobne.img {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:50 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.8517edc0-1328-45f7-9957-985767ac5d44rsvhobne.img Apr 21 21:00:50 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:51 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:52 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.8517edc0-1328-45f7-9957-985767ac5d44rsvhobne.img" returned: 0 in 1.957s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a634c818-7f73-4cdd-81c3-ce070401a22b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:52 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:00:52 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:52 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.559s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.8517edc0-1328-45f7-9957-985767ac5d44rsvhobne.img {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:52 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Converted 1024.00 MB image at 522.85 MB/s Apr 21 21:00:52 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] 8517edc0-1328-45f7-9957-985767ac5d44 was raw, no need to convert to raw {{(pid=82362) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.124s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Uploaded volume to glance image-id: 8517edc0-1328-45f7-9957-985767ac5d44. {{(pid=82362) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 21:01:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e7d16dee-59b2-4bd6-9779-24119a5d2f23 tempest-VolumesActionsTest-1955380404 None] Copy volume to image completed successfully. Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:02 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:02 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:03 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.493s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fecdbc6-0ca8-40de-adc0-f1809bbd37a8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:03 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:01:03 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:03 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.490s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd0a6f9-46e9-47db-9d30-4f7bf54d14ec]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:03 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:01:03 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:04 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:04 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img Apr 21 21:01:04 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:06 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img" returned: 0 in 1.956s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bf061e-7701-4d5d-a55d-68ea864e0855]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:06 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:01:06 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:06 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.612s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:01:06 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Converted 1024.00 MB image at 523.28 MB/s Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] ee1c50cb-3399-4f33-97c7-350e77e6e4d0 was raw, converting to qcow2 {{(pid=82362) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5455a8e-4060-4919-bd22-2bb4256eea4e]: (4, 'raw') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:07 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img Apr 21 21:01:07 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:07 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img" returned: 0 in 0.489s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:07 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img Apr 21 21:01:07 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:07 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img" returned: 1 in 0.471s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img' failed. Not Retrying. {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 21:01:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img /opt/stack/data/cinder/conversion/vol_upload_nal_6txs {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:07 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img /opt/stack/data/cinder/conversion/vol_upload_nal_6txs Apr 21 21:01:07 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:08 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img /opt/stack/data/cinder/conversion/vol_upload_nal_6txs" returned: 0 in 0.433s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:08 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Image conversion details: src /opt/stack/data/cinder/conversion/dfe5d87a-4e92-4689-a075-23350f15f926.temp_image.ee1c50cb-3399-4f33-97c7-350e77e6e4d0wxckpi_f.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nal_6txs {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:01:08 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 21 21:01:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b97cdf0-3aca-4851-832a-273a1a3d4d3c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nal_6txs {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:08 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nal_6txs Apr 21 21:01:08 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:08 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nal_6txs" returned: 0 in 0.452s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.351s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:09 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Uploaded volume to glance image-id: ee1c50cb-3399-4f33-97c7-350e77e6e4d0. {{(pid=82362) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 21:01:09 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3f835f14-b99f-49f7-a34e-1d133631ee25 tempest-VolumesActionsTest-1955380404 None] Copy volume to image completed successfully. Apr 21 21:01:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "cinder-quobyte-dfe5d87a-4e92-4689-a075-23350f15f926" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-quobyte-dfe5d87a-4e92-4689-a075-23350f15f926" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:10 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9957f7-a2a8-4369-b3c3-16fa148e1968]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:11 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:01:11 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:11 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.458s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:11 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926 Apr 21 21:01:11 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:11 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-dfe5d87a-4e92-4689-a075-23350f15f926" returned: 0 in 0.438s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-quobyte-dfe5d87a-4e92-4689-a075-23350f15f926" released by "delete_volume" :: held 0.919s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Created reservations ['cfbc682d-9d91-40d9-a0a9-a41c80e851d2', '122a7f03-61d3-44ad-b5ef-7ea38f1cb3af', '1a8edfe1-42a9-41fd-8227-25829b7dbdfd', '9e08158d-5502-48f5-a90a-c5978c6fdf3e'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:12 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:12 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:12 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.479s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:12 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:12 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Deleted volume successfully. Apr 21 21:01:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-48a12543-e2d0-4c1b-86f6-38369e1d7530 tempest-VolumesActionsTest-1955380404 None] Lock "cinder-dfe5d87a-4e92-4689-a075-23350f15f926-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Flow 'volume_create_manager' (fcd6f7e9-1993-4f92-8ccc-ab8a17d5bdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd87a3c-845e-4c5d-a084-e26d5634bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd87a3c-845e-4c5d-a084-e26d5634bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2075441427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4e82c9-803c-4da6-90f1-9a92bda93b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b18e8aa6ae34ef4a80f6d20847c5841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:17Z,use_quota=True,user_id='f855ac9dd9d74766b3acc571f095bff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dc9987-d66b-4935-9bdb-c9aba460aa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61dc9987-d66b-4935-9bdb-c9aba460aa33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70403475-e734-4a47-9ecf-c14f8ca0504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70403475-e734-4a47-9ecf-c14f8ca0504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4e82c9-803c-4da6-90f1-9a92bda93b87', 'volume_name': 'volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0e9b4-3425-4814-b67b-7ccb2da13683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0e9b4-3425-4814-b67b-7ccb2da13683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e57122a-c465-4df4-b5fb-77d60c79c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:17 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Volume fb4e82c9-803c-4da6-90f1-9a92bda93b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87', 'volume_size': 1} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2075441427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4e82c9-803c-4da6-90f1-9a92bda93b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b18e8aa6ae34ef4a80f6d20847c5841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:17Z,use_quota=True,user_id='f855ac9dd9d74766b3acc571f095bff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Creating volume fb4e82c9-803c-4da6-90f1-9a92bda93b87 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:17 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:01:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:17 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 1073741824 Apr 21 21:01:17 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:18 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 1073741824" returned: 0 in 0.538s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:18 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 Apr 21 21:01:18 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:18 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87" returned: 0 in 0.416s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e57122a-c465-4df4-b5fb-77d60c79c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa94c9d-04e8-4e90-a24a-b7d9573b0d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:18 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Volume volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 (fb4e82c9-803c-4da6-90f1-9a92bda93b87): created successfully Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa94c9d-04e8-4e90-a24a-b7d9573b0d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:18 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Flow 'volume_create_manager' (fcd6f7e9-1993-4f92-8ccc-ab8a17d5bdaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:18 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-85a77822-07c8-4ec1-8b03-2b9e3e680891 tempest-VolumesNegativeTest-1899040619 None] Created volume successfully. Apr 21 21:01:28 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:INSERT=2,cinder:SELECT=20,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:01:28 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:01:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Acquiring lock "cinder-fb4e82c9-803c-4da6-90f1-9a92bda93b87-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Lock "cinder-fb4e82c9-803c-4da6-90f1-9a92bda93b87-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Acquiring lock "cinder-quobyte-fb4e82c9-803c-4da6-90f1-9a92bda93b87" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Lock "cinder-quobyte-fb4e82c9-803c-4da6-90f1-9a92bda93b87" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:42 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32d6e0d-c266-445f-95c4-298908780911]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:42 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 Apr 21 21:01:42 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87" returned: 0 in 0.482s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87 Apr 21 21:01:43 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:43 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-fb4e82c9-803c-4da6-90f1-9a92bda93b87" returned: 0 in 0.420s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Lock "cinder-quobyte-fb4e82c9-803c-4da6-90f1-9a92bda93b87" released by "delete_volume" :: held 0.928s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Created reservations ['952e8aed-f3b6-4bc6-b603-0623ade30582', 'aa568626-b693-4256-aaa8-3a16a44e2715', 'abce596b-f372-4ed2-8052-39ca1f4921ac', '9279ed13-90ff-4438-a2f1-52345ec64642'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:43 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:43 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:44 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.477s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:44 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Deleted volume successfully. Apr 21 21:01:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0d13c222-5dca-4dbe-bbc8-92feab3bdaa6 tempest-VolumesNegativeTest-1899040619 None] Lock "cinder-fb4e82c9-803c-4da6-90f1-9a92bda93b87-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (5b508eca-d11f-40c3-b12a-9ee32d85297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874408c6-3c67-4022-b0d9-c8200df3e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874408c6-3c67-4022-b0d9-c8200df3e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518070259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fc3b29-881e-41bb-9f0a-886c3d6dbaf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:45Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce255e2-1cf9-4829-85ba-d8020aaa9a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce255e2-1cf9-4829-85ba-d8020aaa9a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28c8f63-aa5a-4efc-9e0e-33516552e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28c8f63-aa5a-4efc-9e0e-33516552e49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fc3b29-881e-41bb-9f0a-886c3d6dbaf4', 'volume_name': 'volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fd693f-87de-4d99-9418-71297549eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fd693f-87de-4d99-9418-71297549eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0616f4bc-b059-42b5-b39c-b0105c3e596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Volume 84fc3b29-881e-41bb-9f0a-886c3d6dbaf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4', 'volume_size': 1} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-518070259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fc3b29-881e-41bb-9f0a-886c3d6dbaf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:45Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Creating volume 84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:45 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:45 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 1073741824 Apr 21 21:01:45 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (39e4f250-f560-4dc4-99af-ee12f116b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e03da5-1f54-4bb8-8d35-81f0fff499e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e03da5-1f54-4bb8-8d35-81f0fff499e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1978721843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8250b4b2-dfb1-445e-95e6-83d42ccd3bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:45Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec07964-b46c-4a66-b5b9-cfc3c592f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec07964-b46c-4a66-b5b9-cfc3c592f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e975ac60-766f-44d6-a2a0-07d9d83c92a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e975ac60-766f-44d6-a2a0-07d9d83c92a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8250b4b2-dfb1-445e-95e6-83d42ccd3bce', 'volume_name': 'volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da962622-fe8c-4e8f-8a5a-8280bdd01399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da962622-fe8c-4e8f-8a5a-8280bdd01399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b54a205-e200-40cb-b666-a5e76ad9c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Volume 8250b4b2-dfb1-445e-95e6-83d42ccd3bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce', 'volume_size': 1} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (696d054a-2450-4b46-9afa-09c3b8d23591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c72049b-ede9-4779-aa42-e27cde1d2ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c72049b-ede9-4779-aa42-e27cde1d2ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301427902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6d00f3-63e5-4660-9c8b-8c52157d7a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:46Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180e6b5e-be6b-421f-97c5-bdc5302f178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180e6b5e-be6b-421f-97c5-bdc5302f178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547b7dd8-23a9-4ea5-9c06-dae54d99ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547b7dd8-23a9-4ea5-9c06-dae54d99ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6d00f3-63e5-4660-9c8b-8c52157d7a63', 'volume_name': 'volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e0c158-c14b-499a-82d7-eff1925f03df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e0c158-c14b-499a-82d7-eff1925f03df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24a9b8b-51b3-4140-9b24-e2f81767fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Volume eb6d00f3-63e5-4660-9c8b-8c52157d7a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63', 'volume_size': 1} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (ee64463d-abc1-4951-9801-746c83b4a7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0875e48-e93d-44cf-96d0-18c4cc94f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0875e48-e93d-44cf-96d0-18c4cc94f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419656457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a6fde0-64b4-4c8f-a530-6e4d26e2c97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:46Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4181afa-642a-4d67-a1b5-a2b53187e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4181afa-642a-4d67-a1b5-a2b53187e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1b2006-bbd6-4e38-8a27-362b7bb5d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1b2006-bbd6-4e38-8a27-362b7bb5d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a6fde0-64b4-4c8f-a530-6e4d26e2c97d', 'volume_name': 'volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea48f57-5eef-4dd2-a6e7-20708a76b262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea48f57-5eef-4dd2-a6e7-20708a76b262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34343ec-7c1b-42bf-9b3a-7428f8b3b0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Volume 65a6fde0-64b4-4c8f-a530-6e4d26e2c97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d', 'volume_size': 1} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 1073741824" returned: 0 in 0.695s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:45 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 Apr 21 21:01:45 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (6f45f9d8-a82f-4162-9a48-367c743fbf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791c5de5-963a-4ab6-af37-6509cb61fcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791c5de5-963a-4ab6-af37-6509cb61fcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070344846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:46Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef8d813-621d-4e74-8d83-7008f803fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef8d813-621d-4e74-8d83-7008f803fabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300b9a56-5cae-4a02-9c31-ee19d13ca1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (300b9a56-5cae-4a02-9c31-ee19d13ca1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c', 'volume_name': 'volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7c1210-4147-4ad1-aa35-88dd086a0183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7c1210-4147-4ad1-aa35-88dd086a0183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01060c6a-6ce9-469e-87a1-ec304b09f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Volume 1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c', 'volume_size': 1} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:46 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4" returned: 0 in 0.449s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.920s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1978721843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8250b4b2-dfb1-445e-95e6-83d42ccd3bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:45Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Creating volume 8250b4b2-dfb1-445e-95e6-83d42ccd3bce {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:46 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0616f4bc-b059-42b5-b39c-b0105c3e596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:46 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce 1073741824 Apr 21 21:01:46 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dea782d-1010-4d29-b91d-8ef0acbb969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Volume volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 (84fc3b29-881e-41bb-9f0a-886c3d6dbaf4): created successfully Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dea782d-1010-4d29-b91d-8ef0acbb969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (5b508eca-d11f-40c3-b12a-9ee32d85297a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:46 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-92cd0f1c-13f0-4a7c-9f22-0f9f883d0f0e tempest-CreateVolumesFromImageTest-1060178534 None] Created volume successfully. Apr 21 21:01:46 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce 1073741824" returned: 0 in 0.500s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:46 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce Apr 21 21:01:46 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:47 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301427902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6d00f3-63e5-4660-9c8b-8c52157d7a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:46Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Creating volume eb6d00f3-63e5-4660-9c8b-8c52157d7a63 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:47 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b54a205-e200-40cb-b666-a5e76ad9c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff14022-f055-411f-8c98-6b23b9cc9ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:47 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 1073741824 Apr 21 21:01:47 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:47 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Volume volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce (8250b4b2-dfb1-445e-95e6-83d42ccd3bce): created successfully Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff14022-f055-411f-8c98-6b23b9cc9ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (39e4f250-f560-4dc4-99af-ee12f116b676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-161f3878-9e1b-4998-9378-11eb1feacf23 tempest-CreateVolumesFromImageTest-1060178534 None] Created volume successfully. Apr 21 21:01:47 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 1073741824" returned: 0 in 0.475s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:47 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 Apr 21 21:01:47 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:48 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63" returned: 0 in 0.431s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.385s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419656457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65a6fde0-64b4-4c8f-a530-6e4d26e2c97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:46Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Creating volume 65a6fde0-64b4-4c8f-a530-6e4d26e2c97d {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:48 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d24a9b8b-51b3-4140-9b24-e2f81767fad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cede80-bd46-4e88-97f4-a0a17890fd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:48 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d 1073741824 Apr 21 21:01:48 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:48 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Volume volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 (eb6d00f3-63e5-4660-9c8b-8c52157d7a63): created successfully Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cede80-bd46-4e88-97f4-a0a17890fd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (696d054a-2450-4b46-9afa-09c3b8d23591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:48 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-fdb67a27-787b-461d-9806-eae323cb211f tempest-CreateVolumesFromImageTest-1060178534 None] Created volume successfully. Apr 21 21:01:48 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d 1073741824" returned: 0 in 0.488s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:48 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d Apr 21 21:01:48 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:49 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d" returned: 0 in 0.430s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.163s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1070344846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f0192ce4a147a1adfcfaea42530566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:46Z,use_quota=True,user_id='997ffbda6de84721ba094edae3b56172',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Creating volume 1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:49 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34343ec-7c1b-42bf-9b3a-7428f8b3b0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d915b2-6383-4d71-a937-d6e593d31fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:49 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c 1073741824 Apr 21 21:01:49 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Volume volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d (65a6fde0-64b4-4c8f-a530-6e4d26e2c97d): created successfully Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d915b2-6383-4d71-a937-d6e593d31fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (ee64463d-abc1-4951-9801-746c83b4a7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b9304150-216d-4f8d-9eed-93768674cead tempest-CreateVolumesFromImageTest-1060178534 None] Created volume successfully. Apr 21 21:01:49 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c 1073741824" returned: 0 in 0.529s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:49 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c Apr 21 21:01:49 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:50 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c" returned: 0 in 0.424s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01060c6a-6ce9-469e-87a1-ec304b09f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc42e12-4677-4905-a356-0fad7be8165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:50 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Volume volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c (1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c): created successfully Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc42e12-4677-4905-a356-0fad7be8165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Flow 'volume_create_manager' (6f45f9d8-a82f-4162-9a48-367c743fbf0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:50 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3a32367f-c1a6-46f0-a7c5-8f5dfe7c8b74 tempest-CreateVolumesFromImageTest-1060178534 None] Created volume successfully. Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-quobyte-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1397b61e-f264-434a-a661-00328851606b]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:50 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c Apr 21 21:01:50 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:50 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c" returned: 0 in 0.488s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:51 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c Apr 21 21:01:51 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:51 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c" returned: 0 in 0.412s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c" released by "delete_volume" :: held 0.923s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Created reservations ['b14dee99-cb15-49ef-bd30-9fa3908d6c4c', 'c50448a0-b0ab-4088-a510-a1e5aac506de', 'a1de25a7-e225-46f0-b5e3-c3fde1204556', '01c775b5-97ea-4f72-b004-1c7e4ab18155'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:51 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:51 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-quobyte-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13281c7-b21e-42ae-9ecb-2f2ad707467c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:51 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d Apr 21 21:01:51 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:51 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.478s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:51 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Deleted volume successfully. Apr 21 21:01:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-6de81db5-965a-442d-8c83-35596a9c94be tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-1ffd4a89-dc29-48f9-b9f5-c6e730c62e5c-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:52 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d" returned: 0 in 0.505s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:52 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d Apr 21 21:01:52 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:52 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d" returned: 0 in 0.446s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d" released by "delete_volume" :: held 0.971s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Created reservations ['a58c521a-21e9-4796-ab9b-eefd884d7392', '2743b25b-7d55-4abb-b99f-044c629f15be', '98a82619-4092-467a-bc21-694bd558a675', 'a5c74bcc-0c6f-4a50-adf3-9ba373fe85aa'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:52 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:52 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:53 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.423s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Deleted volume successfully. Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-29a56111-cd37-4197-a4af-7ed2cf9de4d0 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-65a6fde0-64b4-4c8f-a530-6e4d26e2c97d-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-eb6d00f3-63e5-4660-9c8b-8c52157d7a63-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-eb6d00f3-63e5-4660-9c8b-8c52157d7a63-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-quobyte-eb6d00f3-63e5-4660-9c8b-8c52157d7a63" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-eb6d00f3-63e5-4660-9c8b-8c52157d7a63" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf881604-3bcf-4c9e-b5f2-92d77d9f2a8d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:53 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 Apr 21 21:01:53 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63" returned: 0 in 0.482s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63 Apr 21 21:01:54 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-eb6d00f3-63e5-4660-9c8b-8c52157d7a63" returned: 0 in 0.413s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-eb6d00f3-63e5-4660-9c8b-8c52157d7a63" released by "delete_volume" :: held 0.922s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Created reservations ['2054e681-9294-4db7-9169-42b6d1afafe0', 'ee336c9d-4268-490c-9067-2a0dd62afd1e', '67809be7-6a73-4105-b8d7-8176bb1063f4', '9dfd1852-ce79-45e2-bac4-ca246b13966d'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:54 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-8250b4b2-dfb1-445e-95e6-83d42ccd3bce-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-8250b4b2-dfb1-445e-95e6-83d42ccd3bce-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-quobyte-8250b4b2-dfb1-445e-95e6-83d42ccd3bce" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-8250b4b2-dfb1-445e-95e6-83d42ccd3bce" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb68383-a7aa-4213-8213-039d64c78dc2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:54 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce Apr 21 21:01:54 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.444s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:55 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Deleted volume successfully. Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-bfcec391-bff8-41f2-92b6-c11653254bd6 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-eb6d00f3-63e5-4660-9c8b-8c52157d7a63-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:55 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce" returned: 0 in 0.481s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:55 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce Apr 21 21:01:55 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-8250b4b2-dfb1-445e-95e6-83d42ccd3bce" returned: 0 in 0.415s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-8250b4b2-dfb1-445e-95e6-83d42ccd3bce" released by "delete_volume" :: held 0.921s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Created reservations ['9a8c1a73-a49d-44bd-80a8-3830c9511e1b', 'c6b64b5b-51bf-4108-85c3-613ae2686d04', 'f9e75c7c-7e81-4499-8633-256b6107562b', 'c93aabc4-9516-41c5-9742-8cf86204fca1'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:55 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:55 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:55 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "cinder-quobyte-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bab64f-d95a-4ade-b0a4-4ee3ea957cc2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:56 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 Apr 21 21:01:56 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:56 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.475s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:56 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Deleted volume successfully. Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-79675195-ae1b-4f55-a2f6-7cf6a9e1e7a9 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-8250b4b2-dfb1-445e-95e6-83d42ccd3bce-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:56 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4" returned: 0 in 0.496s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:56 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4 Apr 21 21:01:56 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:56 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4" returned: 0 in 0.405s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-quobyte-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4" released by "delete_volume" :: held 0.924s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:56 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Created reservations ['cef1a869-6766-415f-b4b3-402b86f3d660', '69fb0541-d1af-41bb-a3e5-40ba222b34d8', 'f8e6c7e1-b64b-436e-85e8-6fe05968efcb', 'ab9d9750-a30f-49e5-88f2-7162788da586'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:57 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:01:57 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:57 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.480s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:01:57 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Deleted volume successfully. Apr 21 21:01:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-719b2868-c472-41db-8cb6-10c9d6a4ac15 tempest-CreateVolumesFromImageTest-1060178534 None] Lock "cinder-84fc3b29-881e-41bb-9f0a-886c3d6dbaf4-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Flow 'volume_create_manager' (a4950147-d2d7-478e-bc41-488a5af27e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d0bc46-2791-4fcf-9efe-7defdf9fd61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d0bc46-2791-4fcf-9efe-7defdf9fd61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82381f-57b3-4faa-a256-2826e7b8550e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5da07805f3d4bc58dac32e2e98cbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:59Z,use_quota=True,user_id='906172dcd28a4c4f96369aeb1d9d992f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d321fbe3-61ad-40f5-8bc2-ad6e9b8d619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d321fbe3-61ad-40f5-8bc2-ad6e9b8d619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49eb2b6-68e4-4229-8a4f-032a845b7da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49eb2b6-68e4-4229-8a4f-032a845b7da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e82381f-57b3-4faa-a256-2826e7b8550e', 'volume_name': 'volume-9e82381f-57b3-4faa-a256-2826e7b8550e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a35f8e-7a2b-4141-9a55-d6137de3c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a35f8e-7a2b-4141-9a55-d6137de3c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb1d9ba-003c-4a42-afce-2dac79786adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:58 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Volume 9e82381f-57b3-4faa-a256-2826e7b8550e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e82381f-57b3-4faa-a256-2826e7b8550e', 'volume_size': 1} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82381f-57b3-4faa-a256-2826e7b8550e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5da07805f3d4bc58dac32e2e98cbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:01:59Z,use_quota=True,user_id='906172dcd28a4c4f96369aeb1d9d992f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Creating volume 9e82381f-57b3-4faa-a256-2826e7b8550e {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:01:58 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:01:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:58 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e 1073741824 Apr 21 21:01:58 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:59 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e 1073741824" returned: 0 in 0.472s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:01:59 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e Apr 21 21:01:59 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:01:59 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e" returned: 0 in 0.432s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb1d9ba-003c-4a42-afce-2dac79786adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e82381f-57b3-4faa-a256-2826e7b8550e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0e8d48-1587-4b34-8db1-3562365583e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:01:59 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Volume volume-9e82381f-57b3-4faa-a256-2826e7b8550e (9e82381f-57b3-4faa-a256-2826e7b8550e): created successfully Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0e8d48-1587-4b34-8db1-3562365583e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:01:59 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Flow 'volume_create_manager' (a4950147-d2d7-478e-bc41-488a5af27e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:01:59 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3737b0dd-acad-46df-99f5-4f9200c1d69b tempest-CinderUnicodeTest-1217905622 None] Created volume successfully. Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Flow 'volume_create_manager' (b0f0ffbc-1de8-4a66-8674-869dc3b872a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6701ce62-7816-48e1-8a74-ce49808c2e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6701ce62-7816-48e1-8a74-ce49808c2e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-491480051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eef1ea1-b47b-42a4-a15a-ff18823f1644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5da07805f3d4bc58dac32e2e98cbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:01Z,use_quota=True,user_id='906172dcd28a4c4f96369aeb1d9d992f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b1af9e-6930-4ba5-b69e-2868b3036275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b1af9e-6930-4ba5-b69e-2868b3036275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51432498-a591-4db5-a790-764424e01354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51432498-a591-4db5-a790-764424e01354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eef1ea1-b47b-42a4-a15a-ff18823f1644', 'volume_name': 'volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabe51a7-13f4-41d8-bb00-00440c12f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabe51a7-13f4-41d8-bb00-00440c12f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e4ca54-d4b5-4d47-adfe-4657c76d3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:01 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Volume 9eef1ea1-b47b-42a4-a15a-ff18823f1644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644', 'volume_size': 1} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-491480051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eef1ea1-b47b-42a4-a15a-ff18823f1644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5da07805f3d4bc58dac32e2e98cbabd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:01Z,use_quota=True,user_id='906172dcd28a4c4f96369aeb1d9d992f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Creating volume 9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:01 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:01 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 1073741824 Apr 21 21:02:01 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:01 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 1073741824" returned: 0 in 0.480s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:01 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 Apr 21 21:02:01 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:02 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644" returned: 0 in 0.419s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e4ca54-d4b5-4d47-adfe-4657c76d3d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f220c447-5f9b-40b0-8f39-ed154e100d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:02 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Volume volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 (9eef1ea1-b47b-42a4-a15a-ff18823f1644): created successfully Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f220c447-5f9b-40b0-8f39-ed154e100d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Flow 'volume_create_manager' (b0f0ffbc-1de8-4a66-8674-869dc3b872a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:02 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-23c4ce71-cce5-4729-b700-d38287b39b61 tempest-CinderUnicodeTest-1217905622 None] Created volume successfully. Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:02 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:02 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:02 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:02 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:03 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Creating offline snapshot dd5c3932-fd6d-438b-accb-14a17b2fe593 of volume 9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[17add1ef-9c0a-40b7-ba12-01c7e27c88d2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:03 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 Apr 21 21:02:03 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:04 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644" returned: 0 in 0.536s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:04 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 1G Apr 21 21:02:04 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:04 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 1G" returned: 0 in 0.501s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:04 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 Apr 21 21:02:04 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:05 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593" returned: 0 in 0.441s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:05 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 is being set with open permissions: ugo+rw Apr 21 21:02:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:05 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 Apr 21 21:02:05 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:05 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593" returned: 0 in 0.413s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:05 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.info Apr 21 21:02:05 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:05 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.info" returned: 0 in 0.431s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:05 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.info is being set with open permissions: ugo+rw Apr 21 21:02:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:05 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.info Apr 21 21:02:05 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:06 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.info" returned: 0 in 0.416s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.796s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-144c2ce6-2241-45ba-8400-43906b943a84 tempest-CinderUnicodeTest-1217905622 None] Create snapshot completed successfully Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "cinder-dd5c3932-fd6d-438b-accb-14a17b2fe593-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-dd5c3932-fd6d-438b-accb-14a17b2fe593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "cinder-quobyte-9eef1ea1-b47b-42a4-a15a-ff18823f1644" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-9eef1ea1-b47b-42a4-a15a-ff18823f1644" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "cinder-quobyte-dd5c3932-fd6d-438b-accb-14a17b2fe593" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-dd5c3932-fd6d-438b-accb-14a17b2fe593" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Deleting offline snapshot dd5c3932-fd6d-438b-accb-14a17b2fe593 of volume 9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] snapshot_file for this snap is: volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcfdcd8-75a2-461e-83ba-42c4e3612374]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:06 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 Apr 21 21:02:06 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:07 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593" returned: 0 in 0.476s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[185699b2-1f2f-4e27-9f2d-443a5edb7e10]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:07 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 Apr 21 21:02:07 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:07 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644" returned: 0 in 0.467s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:07 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 Apr 21 21:02:07 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:08 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593" returned: 0 in 0.474s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:08 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593 Apr 21 21:02:08 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:08 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644.dd5c3932-fd6d-438b-accb-14a17b2fe593" returned: 0 in 0.447s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-dd5c3932-fd6d-438b-accb-14a17b2fe593" released by "_delete_snapshot" :: held 1.920s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-9eef1ea1-b47b-42a4-a15a-ff18823f1644" released by "delete_snapshot" :: held 1.935s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Created reservations ['049330ec-ca90-4448-9e5e-5dd07f4dd449', '4e0da287-57c9-43b5-ad32-4069a68fe46f', '7ed10673-fff6-4d63-851c-514ec6d7a0ae', 'fd8ec790-529b-41a6-9ddf-0326317f3791'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:08 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Delete snapshot completed successfully. Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-e98d0e8f-db1f-49d2-b200-6de374276cff tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-dd5c3932-fd6d-438b-accb-14a17b2fe593-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "cinder-9eef1ea1-b47b-42a4-a15a-ff18823f1644-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-9eef1ea1-b47b-42a4-a15a-ff18823f1644-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "cinder-quobyte-9eef1ea1-b47b-42a4-a15a-ff18823f1644" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-9eef1ea1-b47b-42a4-a15a-ff18823f1644" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd9f0ac-08ea-4e38-ae1e-50b354771fe0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:08 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 Apr 21 21:02:08 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644" returned: 0 in 0.473s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:09 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644 Apr 21 21:02:09 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9eef1ea1-b47b-42a4-a15a-ff18823f1644" returned: 0 in 0.412s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-9eef1ea1-b47b-42a4-a15a-ff18823f1644" released by "delete_volume" :: held 0.924s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Created reservations ['395bdb68-96d8-4e2c-a860-ebc418cd6da2', 'f1ece789-ab45-41db-add6-651b313a46d0', 'd357f90a-9b67-41b8-9e57-79f7be9456e5', 'b8c5896b-d395-40e9-bc25-598da7522a33'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:09 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:09 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "cinder-9e82381f-57b3-4faa-a256-2826e7b8550e-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-9e82381f-57b3-4faa-a256-2826e7b8550e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "cinder-quobyte-9e82381f-57b3-4faa-a256-2826e7b8550e" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-9e82381f-57b3-4faa-a256-2826e7b8550e" acquired by "delete_volume" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb3e0b0-cfac-4d7b-bd96-d73dd96dc174]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:10 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e Apr 21 21:02:10 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:10 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.469s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:10 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:10 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Deleted volume successfully. Apr 21 21:02:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f377233c-98a5-4b27-b130-cce6e30ebb99 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-9eef1ea1-b47b-42a4-a15a-ff18823f1644-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:10 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e" returned: 0 in 0.566s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:10 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e Apr 21 21:02:10 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:10 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-9e82381f-57b3-4faa-a256-2826e7b8550e" returned: 0 in 0.422s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-quobyte-9e82381f-57b3-4faa-a256-2826e7b8550e" released by "delete_volume" :: held 1.013s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Created reservations ['ba8f3b9c-0668-451f-a1e7-78f4a273f242', '5525d4bb-b909-4801-8168-8c6f78cf4eb2', '5a873f71-8e38-4b2a-a463-18e6cb416d99', 'feac88af-7e4b-472c-944a-c7691a0e5e92'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:11 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:11 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:11 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.483s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Deleted volume successfully. Apr 21 21:02:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-b50ea3d9-d9a2-4688-9db9-d7d8ce5e0be5 tempest-CinderUnicodeTest-1217905622 None] Lock "cinder-9e82381f-57b3-4faa-a256-2826e7b8550e-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (b8ab4fb2-13ac-43d7-b88b-befd9e47eb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2294021d-8ce4-4c31-99ed-51be7a15d15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2294021d-8ce4-4c31-99ed-51be7a15d15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265635301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77eee95a-2c2b-43bd-a651-e4293352972a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb7f87a8014a3aa392312df4e5fc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='6a339328ab7c4634af9ad8351549a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48e1ba4-b3ce-473d-86be-1da18874d02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a48e1ba4-b3ce-473d-86be-1da18874d02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f640ec7a-7555-4296-94b7-110fd662b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f640ec7a-7555-4296-94b7-110fd662b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77eee95a-2c2b-43bd-a651-e4293352972a', 'volume_name': 'volume-77eee95a-2c2b-43bd-a651-e4293352972a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c0a7df-4afb-4561-a566-3f8361e53bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c0a7df-4afb-4561-a566-3f8361e53bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed76521-29d6-42e3-aa18-e867b08230dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Volume 77eee95a-2c2b-43bd-a651-e4293352972a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77eee95a-2c2b-43bd-a651-e4293352972a', 'volume_size': 1} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265635301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77eee95a-2c2b-43bd-a651-e4293352972a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb7f87a8014a3aa392312df4e5fc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='6a339328ab7c4634af9ad8351549a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Creating volume 77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:19 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (65773581-1622-497b-a2c1-3c223661f7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:19 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd382537-7336-4fbe-8c5e-e7c29e6ffc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:19 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a 1073741824 Apr 21 21:02:19 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd382537-7336-4fbe-8c5e-e7c29e6ffc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724462510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04652550-d0ef-47bb-a39c-7d046d437f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df73bcb0-39e8-4273-8606-ef0e928bc684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df73bcb0-39e8-4273-8606-ef0e928bc684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df45499a-1f4b-4ef1-8e74-497ded684d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df45499a-1f4b-4ef1-8e74-497ded684d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04652550-d0ef-47bb-a39c-7d046d437f78', 'volume_name': 'volume-04652550-d0ef-47bb-a39c-7d046d437f78', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8930f603-f304-45f2-892f-df2249015346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8930f603-f304-45f2-892f-df2249015346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233136fd-8674-4469-8212-37087c238dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume 04652550-d0ef-47bb-a39c-7d046d437f78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04652550-d0ef-47bb-a39c-7d046d437f78', 'volume_size': 1} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (29701856-bab8-4c3b-9e1b-50cf3235a254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a986cf76-8330-45df-9c66-9a188356cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a986cf76-8330-45df-9c66-9a188356cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-621356609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70439ff9-6221-4f29-9ce5-79dc9b75f591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4ba7dc-c3ba-4968-997f-2b62808532ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4ba7dc-c3ba-4968-997f-2b62808532ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a500a68-f358-4850-9d3a-29f662dd51da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a500a68-f358-4850-9d3a-29f662dd51da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70439ff9-6221-4f29-9ce5-79dc9b75f591', 'volume_name': 'volume-70439ff9-6221-4f29-9ce5-79dc9b75f591', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26837861-a906-4edd-8344-a6b34cdabefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26837861-a906-4edd-8344-a6b34cdabefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51ca543-295c-4def-b3eb-d73ddf907e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Volume 70439ff9-6221-4f29-9ce5-79dc9b75f591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70439ff9-6221-4f29-9ce5-79dc9b75f591', 'volume_size': 1} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (3210608d-c416-42ce-b548-b986b81dae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bb2eef-3624-47eb-aba4-b19e400c2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bb2eef-3624-47eb-aba4-b19e400c2c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971437516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36339fb4-655d-4a43-b0e9-c9ff5b13309b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24df43bc-715a-4897-a2cf-13a570d09625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24df43bc-715a-4897-a2cf-13a570d09625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2813542-7901-4c9f-bce3-b273e0e92094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2813542-7901-4c9f-bce3-b273e0e92094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36339fb4-655d-4a43-b0e9-c9ff5b13309b', 'volume_name': 'volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38782d98-95cb-4723-98c0-25a5943f434b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38782d98-95cb-4723-98c0-25a5943f434b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db6fa41-90c5-4ecd-88e1-4375613fd2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Volume 36339fb4-655d-4a43-b0e9-c9ff5b13309b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b', 'volume_size': 1} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (15ee5395-7b12-4e29-b1da-2c5027696cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d260f69-1645-478d-90d9-b21f14f3819d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d260f69-1645-478d-90d9-b21f14f3819d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1618414718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3a4f90-ba99-4318-9bb7-9d68a0cd7f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3a4f90-ba99-4318-9bb7-9d68a0cd7f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc4aaa8-854d-4680-aed0-a7580cd3990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc4aaa8-854d-4680-aed0-a7580cd3990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa', 'volume_name': 'volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d681064-f9e7-42dc-905d-4b21d2c59570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d681064-f9e7-42dc-905d-4b21d2c59570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c83139-2a40-4855-826d-ff189af9c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Volume 4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa', 'volume_size': 1} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:20 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a 1073741824" returned: 0 in 0.717s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:20 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a Apr 21 21:02:20 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (dc718d00-52e1-4d7a-ab79-c5f44a7ec1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e735c7-0a4d-49c6-902b-b4115825ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e735c7-0a4d-49c6-902b-b4115825ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821267668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5efec32-bc94-4cd6-b2f6-8bc494497c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:21Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb39f33a-24c6-4a35-bd2d-c2b7e9354414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb39f33a-24c6-4a35-bd2d-c2b7e9354414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d4a0c3-c66a-416c-9a2c-c54e9f859d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d4a0c3-c66a-416c-9a2c-c54e9f859d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5efec32-bc94-4cd6-b2f6-8bc494497c4b', 'volume_name': 'volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71894637-919d-4956-92a6-a33d219df4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71894637-919d-4956-92a6-a33d219df4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5e2df8-9d38-499c-83ab-da909b3b254d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Volume f5efec32-bc94-4cd6-b2f6-8bc494497c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b', 'volume_size': 1} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (91fa61d5-cabd-4f08-b57d-ceba1798f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed27e76c-612e-46ed-901c-c6f03196d7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed27e76c-612e-46ed-901c-c6f03196d7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-194494579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4ec3f5-c514-493b-90cb-a0b5616013ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:21Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d5dfc1-cdf4-4cef-b34a-72c521c2d72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d5dfc1-cdf4-4cef-b34a-72c521c2d72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f67985c-566c-43ca-b50b-51629eb277ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f67985c-566c-43ca-b50b-51629eb277ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4ec3f5-c514-493b-90cb-a0b5616013ad', 'volume_name': 'volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffa0e9f-869d-4bd4-bc1c-692e3f34a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffa0e9f-869d-4bd4-bc1c-692e3f34a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a25d7b9-e91f-4a57-8c45-316554a7b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:20 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Volume cd4ec3f5-c514-493b-90cb-a0b5616013ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad', 'volume_size': 1} Apr 21 21:02:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:21 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a" returned: 0 in 0.561s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-724462510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04652550-d0ef-47bb-a39c-7d046d437f78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Creating volume 04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:21 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed76521-29d6-42e3-aa18-e867b08230dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77eee95a-2c2b-43bd-a651-e4293352972a', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0ec742-ba3b-422c-8c6d-cbeda4db0e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:21 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 1073741824 Apr 21 21:02:21 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:21 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Volume volume-77eee95a-2c2b-43bd-a651-e4293352972a (77eee95a-2c2b-43bd-a651-e4293352972a): created successfully Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0ec742-ba3b-422c-8c6d-cbeda4db0e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (b8ab4fb2-13ac-43d7-b88b-befd9e47eb19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-0f26f3a8-aac1-4b3c-9444-3dd1c9ca1e3b tempest-VolumeDependencyTests-88289789 None] Created volume successfully. Apr 21 21:02:21 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 1073741824" returned: 0 in 0.515s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:21 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 Apr 21 21:02:21 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78" returned: 0 in 0.547s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.161s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-621356609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70439ff9-6221-4f29-9ce5-79dc9b75f591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Creating volume 70439ff9-6221-4f29-9ce5-79dc9b75f591 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:22 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233136fd-8674-4469-8212-37087c238dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04652550-d0ef-47bb-a39c-7d046d437f78', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 1073741824 Apr 21 21:02:22 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a07c0a-c468-4bf2-8cc0-d892b9b4a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:22 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume volume-04652550-d0ef-47bb-a39c-7d046d437f78 (04652550-d0ef-47bb-a39c-7d046d437f78): created successfully Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a07c0a-c468-4bf2-8cc0-d892b9b4a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (65773581-1622-497b-a2c1-3c223661f7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:22 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-079306c4-55b8-46c1-ad02-61ff2307335d tempest-CreateVolumesFromSnapshotTest-250389097 None] Created volume successfully. Apr 21 21:02:22 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 1073741824" returned: 0 in 0.624s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:23 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 Apr 21 21:02:23 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:23 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591" returned: 0 in 0.532s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.233s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-971437516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36339fb4-655d-4a43-b0e9-c9ff5b13309b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Creating volume 36339fb4-655d-4a43-b0e9-c9ff5b13309b {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:23 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51ca543-295c-4def-b3eb-d73ddf907e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70439ff9-6221-4f29-9ce5-79dc9b75f591', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ea929d-598e-42a0-944d-28952feb9395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:23 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b 1073741824 Apr 21 21:02:23 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:23 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Volume volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 (70439ff9-6221-4f29-9ce5-79dc9b75f591): created successfully Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ea929d-598e-42a0-944d-28952feb9395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:23 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (29701856-bab8-4c3b-9e1b-50cf3235a254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-e867f6b3-22be-4837-8ff8-7406185fee07 tempest-CreateVolumesFromImageTest-961519088 None] Created volume successfully. Apr 21 21:02:24 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b 1073741824" returned: 0 in 0.538s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:24 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b Apr 21 21:02:24 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:24 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b" returned: 0 in 0.473s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.026s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1618414718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:20Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Creating volume 4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:24 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db6fa41-90c5-4ecd-88e1-4375613fd2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:24 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa 1073741824 Apr 21 21:02:24 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa29dfe0-ee14-4248-9068-a19313688fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:24 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Volume volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b (36339fb4-655d-4a43-b0e9-c9ff5b13309b): created successfully Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa29dfe0-ee14-4248-9068-a19313688fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:24 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (3210608d-c416-42ce-b548-b986b81dae6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:24 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d45f7566-68c1-428f-8925-b957263998c2 tempest-CreateVolumesFromImageTest-961519088 None] Created volume successfully. Apr 21 21:02:25 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa 1073741824" returned: 0 in 0.666s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:25 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa Apr 21 21:02:25 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:25 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa" returned: 0 in 0.551s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.110s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821267668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5efec32-bc94-4cd6-b2f6-8bc494497c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:21Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Creating volume f5efec32-bc94-4cd6-b2f6-8bc494497c4b {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:25 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c83139-2a40-4855-826d-ff189af9c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcaf7b2-e5db-4b4d-a9b3-4acdfb0d0e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:25 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b 1073741824 Apr 21 21:02:25 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:25 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Volume volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa (4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa): created successfully Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcaf7b2-e5db-4b4d-a9b3-4acdfb0d0e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:25 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (15ee5395-7b12-4e29-b1da-2c5027696cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:25 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a42209bb-af8e-42d7-a9cc-0bef540c138c tempest-CreateVolumesFromImageTest-961519088 None] Created volume successfully. Apr 21 21:02:26 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b 1073741824" returned: 0 in 0.590s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:26 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:26 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b Apr 21 21:02:26 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:27 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b" returned: 0 in 0.521s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.083s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-194494579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4ec3f5-c514-493b-90cb-a0b5616013ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0612dbec6a4549dc8bbc7d781303c618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:21Z,use_quota=True,user_id='4187b1ee444b4ce5abf83b7ea15760d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Creating volume cd4ec3f5-c514-493b-90cb-a0b5616013ad {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:27 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5e2df8-9d38-499c-83ab-da909b3b254d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59f9ce7-23bd-400e-affa-6235f203e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:27 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad 1073741824 Apr 21 21:02:27 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:27 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Volume volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b (f5efec32-bc94-4cd6-b2f6-8bc494497c4b): created successfully Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59f9ce7-23bd-400e-affa-6235f203e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (dc718d00-52e1-4d7a-ab79-c5f44a7ec1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:27 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ae7d728e-ee0d-47c6-8f85-e9ff6137a771 tempest-CreateVolumesFromImageTest-961519088 None] Created volume successfully. Apr 21 21:02:27 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad 1073741824" returned: 0 in 0.601s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:27 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:27 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad Apr 21 21:02:27 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:28 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad" returned: 0 in 0.523s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.090s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a25d7b9-e91f-4a57-8c45-316554a7b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf445560-a140-463e-91c1-b5ad72990eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Creating offline snapshot 7b7cd4ac-a131-4932-a135-2275c9ef642a of volume 77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:28 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Volume volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad (cd4ec3f5-c514-493b-90cb-a0b5616013ad): created successfully Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf445560-a140-463e-91c1-b5ad72990eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Flow 'volume_create_manager' (91fa61d5-cabd-4f08-b57d-ceba1798f00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3fb3a-4c09-4095-b922-71b1f8fee4a0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:28 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a8e27405-49de-4c7a-9da3-9e7878361400 tempest-CreateVolumesFromImageTest-961519088 None] Created volume successfully. Apr 21 21:02:28 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a Apr 21 21:02:28 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-cd4ec3f5-c514-493b-90cb-a0b5616013ad-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-cd4ec3f5-c514-493b-90cb-a0b5616013ad-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-quobyte-cd4ec3f5-c514-493b-90cb-a0b5616013ad" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-cd4ec3f5-c514-493b-90cb-a0b5616013ad" acquired by "delete_volume" :: waited 0.030s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38be2a7-f7f3-4f3b-aecb-670568ace3cb]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:28 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a" returned: 0 in 0.541s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:28 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:28 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a 1G Apr 21 21:02:28 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:28 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad Apr 21 21:02:28 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:29 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad" returned: 0 in 0.613s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:29 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a 1G" returned: 0 in 0.591s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77eee95a-2c2b-43bd-a651-e4293352972a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:29 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad Apr 21 21:02:29 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:29 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77eee95a-2c2b-43bd-a651-e4293352972a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a Apr 21 21:02:29 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:29 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-cd4ec3f5-c514-493b-90cb-a0b5616013ad" returned: 0 in 0.516s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-cd4ec3f5-c514-493b-90cb-a0b5616013ad" released by "delete_volume" :: held 1.153s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:29 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77eee95a-2c2b-43bd-a651-e4293352972a -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a" returned: 0 in 0.521s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:29 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a is being set with open permissions: ugo+rw Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:29 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a Apr 21 21:02:29 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Created reservations ['3fbbdc65-7400-4749-b8a2-d0ddf6cd5e01', 'c850dd75-7c04-4db6-9e18-f525f5ca88d1', '29b76cf7-566b-45b4-bce8-5a57cbf4324c', '1b1b620e-5e7f-4d61-b647-09f5e5de6e2c'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:29 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:30 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:30 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:30 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a" returned: 0 in 0.451s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:30 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.info Apr 21 21:02:30 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:30 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.564s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:30 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Deleted volume successfully. Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-60b5bc4d-64d3-408a-bf6a-2a9c1b92d191 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-cd4ec3f5-c514-493b-90cb-a0b5616013ad-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:30 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.info" returned: 0 in 0.438s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:30 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.info is being set with open permissions: ugo+rw Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:30 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.info Apr 21 21:02:30 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-f5efec32-bc94-4cd6-b2f6-8bc494497c4b-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-f5efec32-bc94-4cd6-b2f6-8bc494497c4b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-quobyte-f5efec32-bc94-4cd6-b2f6-8bc494497c4b" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-f5efec32-bc94-4cd6-b2f6-8bc494497c4b" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ef28d-2588-44a0-af38-3336dbc61106]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:30 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:31 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b Apr 21 21:02:31 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:31 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.info" returned: 0 in 0.456s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.093s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.155s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Creating offline snapshot 31608b65-8beb-46b2-860d-f2db5ba9912b of volume 04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:31 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9c5bc2a0-c97c-4911-8105-3e7d2517ee2b tempest-VolumeDependencyTests-88289789 None] Create snapshot completed successfully Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d3f908-7d2a-46c5-86bc-56d2784cffd5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:31 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 Apr 21 21:02:31 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:31 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b" returned: 0 in 0.558s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:31 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b Apr 21 21:02:31 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (2aabf9a3-c3f1-414d-bf68-e22c3f025fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a3b863-06c8-4e55-9454-d6a1676c660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a3b863-06c8-4e55-9454-d6a1676c660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-297979326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56597151-330c-4dd2-bc9c-2e51f15a3743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb7f87a8014a3aa392312df4e5fc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b7cd4ac-a131-4932-a135-2275c9ef642a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:32Z,use_quota=True,user_id='6a339328ab7c4634af9ad8351549a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baf1ca9-c62e-46d4-ae1a-177a4bb20cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baf1ca9-c62e-46d4-ae1a-177a4bb20cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d7ad85-b93b-4390-bf04-f4cc704aa18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d7ad85-b93b-4390-bf04-f4cc704aa18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '56597151-330c-4dd2-bc9c-2e51f15a3743', 'volume_name': 'volume-56597151-330c-4dd2-bc9c-2e51f15a3743', 'volume_size': 1, 'snapshot_id': '7b7cd4ac-a131-4932-a135-2275c9ef642a'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac65b0c6-ad06-4000-aa31-ee204f2335b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac65b0c6-ad06-4000-aa31-ee204f2335b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62ef7fd-aa83-480c-88b0-2e090da6dc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:31 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Volume 56597151-330c-4dd2-bc9c-2e51f15a3743: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-56597151-330c-4dd2-bc9c-2e51f15a3743', 'volume_size': 1, 'snapshot_id': '7b7cd4ac-a131-4932-a135-2275c9ef642a'} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:31 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78" returned: 0 in 0.611s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:31 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:31 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b 1G Apr 21 21:02:31 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f5efec32-bc94-4cd6-b2f6-8bc494497c4b" returned: 0 in 0.667s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-f5efec32-bc94-4cd6-b2f6-8bc494497c4b" released by "delete_volume" :: held 1.249s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Created reservations ['d542b5ea-82d6-4ded-9106-986758df8c6a', '6443e547-d944-4688-b7d9-f99977672abd', '7d74710f-9d3c-41f0-835e-ece95ddb584b', '973fe0bf-c1a4-4f3a-b864-20e5f61753d5'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:32 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b 1G" returned: 0 in 0.589s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04652550-d0ef-47bb-a39c-7d046d437f78 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:32 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04652550-d0ef-47bb-a39c-7d046d437f78 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b Apr 21 21:02:32 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:32 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.552s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:32 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Deleted volume successfully. Apr 21 21:02:32 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ba918d6a-04da-4754-b710-290289dbf796 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-f5efec32-bc94-4cd6-b2f6-8bc494497c4b-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:33 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04652550-d0ef-47bb-a39c-7d046d437f78 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b" returned: 0 in 0.554s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b is being set with open permissions: ugo+rw Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-quobyte-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:33 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b Apr 21 21:02:33 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8b6ca1-7bc6-4b7e-adec-06603ad51a7d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa Apr 21 21:02:33 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.info Apr 21 21:02:33 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:33 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa" returned: 0 in 0.568s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:33 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:33 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa Apr 21 21:02:33 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:34 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.info" returned: 0 in 0.449s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.info is being set with open permissions: ugo+rw Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:34 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.info Apr 21 21:02:34 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:34 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa" returned: 0 in 0.518s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa" released by "delete_volume" :: held 1.112s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Created reservations ['19da5bfc-49e0-42c1-8954-dbd19cce9310', '755b2a4f-55f8-4333-8ee4-14de81f633b5', '678eb152-7a42-47be-873f-2bc8a6ff6385', '2d61708b-2751-42a6-aa99-16205024e4b5'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:34 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:34 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:34 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.info" returned: 0 in 0.582s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.359s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.753s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-7b7cd4ac-a131-4932-a135-2275c9ef642a-56597151-330c-4dd2-bc9c-2e51f15a3743" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-7b7cd4ac-a131-4932-a135-2275c9ef642a-56597151-330c-4dd2-bc9c-2e51f15a3743" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Creating volume 56597151-330c-4dd2-bc9c-2e51f15a3743 from snapshot 7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-56597151-330c-4dd2-bc9c-2e51f15a3743" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:34 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-0d4b3d60-a301-4838-b47a-f276c70234d8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Create snapshot completed successfully Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-56597151-330c-4dd2-bc9c-2e51f15a3743" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] snapshot: 7b7cd4ac-a131-4932-a135-2275c9ef642a, volume: 56597151-330c-4dd2-bc9c-2e51f15a3743, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a09d8e7-c04b-4b83-a4e2-46b62f8cea09]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:34 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.492s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:34 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Deleted volume successfully. Apr 21 21:02:34 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c064fc9b-d43a-4639-ade4-92b18d7a3007 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-4c6b607c-37cb-4e76-b6d3-9bfdfdc42efa-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:34 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a Apr 21 21:02:34 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-36339fb4-655d-4a43-b0e9-c9ff5b13309b-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-36339fb4-655d-4a43-b0e9-c9ff5b13309b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-quobyte-36339fb4-655d-4a43-b0e9-c9ff5b13309b" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-36339fb4-655d-4a43-b0e9-c9ff5b13309b" acquired by "delete_volume" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc2e7c7-c61c-4aee-b635-4ed97b3027dc]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:35 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a" returned: 0 in 0.663s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77eee95a-2c2b-43bd-a651-e4293352972a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a590d23-2e85-43bc-b4fd-01895e085ea9]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:35 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b Apr 21 21:02:35 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a Apr 21 21:02:35 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (6cb9b78c-76b2-49f4-8d92-4e60c62d935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059eace7-9b3e-483b-ac82-04cd93635be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059eace7-9b3e-483b-ac82-04cd93635be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1099885586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d791901e-8040-498c-ac22-7c3e2eb03c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:36Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7f85e0-f2cb-43eb-ae6f-5909dd729096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7f85e0-f2cb-43eb-ae6f-5909dd729096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93cc261-f18a-4eb1-afce-8b16e3b7f337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93cc261-f18a-4eb1-afce-8b16e3b7f337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd791901e-8040-498c-ac22-7c3e2eb03c71', 'volume_name': 'volume-d791901e-8040-498c-ac22-7c3e2eb03c71', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:35 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c152fda-cc56-458b-acbb-cf7940a5927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c152fda-cc56-458b-acbb-cf7940a5927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbd2e22-dea0-47c8-9f77-108010bf3f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume d791901e-8040-498c-ac22-7c3e2eb03c71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d791901e-8040-498c-ac22-7c3e2eb03c71', 'volume_size': 1} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:36 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b" returned: 0 in 0.673s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:36 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b Apr 21 21:02:36 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (690e52f1-9ae5-405c-a903-c2b5ba494311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290c3337-abd6-46f7-9933-4926111f6e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290c3337-abd6-46f7-9933-4926111f6e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133910025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676ed29d-e508-48bf-9832-e8fa5ae47fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:36Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0795cec0-922b-4ec8-b4de-13859733439b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0795cec0-922b-4ec8-b4de-13859733439b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28867358-e182-4b92-bb9a-6b53d3460670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28867358-e182-4b92-bb9a-6b53d3460670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676ed29d-e508-48bf-9832-e8fa5ae47fe4', 'volume_name': 'volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc24a99-8091-4e0b-ba23-ca8dcd3e0068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc24a99-8091-4e0b-ba23-ca8dcd3e0068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a19b7e-c833-4c81-a00e-e870ad1808bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume 676ed29d-e508-48bf-9832-e8fa5ae47fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4', 'volume_size': 1} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a" returned: 0 in 0.903s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:36 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 Apr 21 21:02:36 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:36 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-36339fb4-655d-4a43-b0e9-c9ff5b13309b" returned: 0 in 0.496s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-36339fb4-655d-4a43-b0e9-c9ff5b13309b" released by "delete_volume" :: held 1.207s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (e2d7ccdf-a2f6-4328-85aa-f0dbfc682326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68e15d3-bb43-4adb-8145-40cac198cc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68e15d3-bb43-4adb-8145-40cac198cc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024882695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d42b8e2-d99c-4d98-8b02-d54ddd1d4669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:37Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d7e707-eee7-454a-b2ba-63e5f61f39c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d7e707-eee7-454a-b2ba-63e5f61f39c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e95ed42-bb3a-4b11-8aee-8b6838ce7262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e95ed42-bb3a-4b11-8aee-8b6838ce7262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d42b8e2-d99c-4d98-8b02-d54ddd1d4669', 'volume_name': 'volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b4197c-8ed2-4149-8716-c062f30d9068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b4197c-8ed2-4149-8716-c062f30d9068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ed6f2b-f196-48be-bc9c-4a2d9b9c5ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:36 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume 3d42b8e2-d99c-4d98-8b02-d54ddd1d4669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669', 'volume_size': 1} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Created reservations ['54ee2b89-3e46-4433-a494-8fe3e1cf3b2c', '112af548-cc75-4ccd-b4a2-a266d2c9fc03', '16333d72-d29d-4d06-b927-c923406767e8', '039f43b5-e812-4218-91f7-d3735caf99f2'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:36 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:36 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:36 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (16f91692-2732-466b-a27f-a6bcf8491bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7726a754-846c-4610-94ef-b268933032b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7726a754-846c-4610-94ef-b268933032b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144482946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:37Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662a93c9-5edd-400e-b42f-3ce137e1424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662a93c9-5edd-400e-b42f-3ce137e1424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0e876f-882d-4232-b299-258b2d329195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0e876f-882d-4232-b299-258b2d329195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b', 'volume_name': 'volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535402d0-39f2-469d-8feb-c768ee849e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535402d0-39f2-469d-8feb-c768ee849e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3330e55a-80ba-4d55-97e8-f56ace086abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b', 'volume_size': 1} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (a8525912-5661-4bc3-9dec-4e9389ace498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff739b4-00f3-46e3-a108-cf4868a164c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff739b4-00f3-46e3-a108-cf4868a164c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-927088607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46be56d0-a821-4c1f-99af-9ec671c8f722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:37Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069e94c9-442e-447a-81e9-1c608b4b57e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069e94c9-442e-447a-81e9-1c608b4b57e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad55d00-e5c9-46c5-87cb-39ef48f68c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad55d00-e5c9-46c5-87cb-39ef48f68c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46be56d0-a821-4c1f-99af-9ec671c8f722', 'volume_name': 'volume-46be56d0-a821-4c1f-99af-9ec671c8f722', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b6bd28-702f-4513-a7b5-037dfc773d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b6bd28-702f-4513-a7b5-037dfc773d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9981f572-fd08-4263-9249-0a439c7440c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:37 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume 46be56d0-a821-4c1f-99af-9ec671c8f722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46be56d0-a821-4c1f-99af-9ec671c8f722', 'volume_size': 1} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-70439ff9-6221-4f29-9ce5-79dc9b75f591-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-70439ff9-6221-4f29-9ce5-79dc9b75f591-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:37 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 1.063s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:37 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Deleted volume successfully. Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "cinder-quobyte-70439ff9-6221-4f29-9ce5-79dc9b75f591" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7ae244a0-18ed-4d87-a014-31d4d3d15d59 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-36339fb4-655d-4a43-b0e9-c9ff5b13309b-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-70439ff9-6221-4f29-9ce5-79dc9b75f591" acquired by "delete_volume" :: waited 0.028s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c0924-9e54-4496-86d8-50f491fd71d3]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:37 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:38 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 Apr 21 21:02:38 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:UPDATE=164,cinder:SELECT=113,cinder:INSERT=25,cinder:DELETE=15 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:02:39 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=112,cinder:INSERT=44,cinder:UPDATE=140,cinder:DELETE=14 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743" returned: 0 in 2.895s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Flow 'volume_create_manager' (6e0e6aea-f2f0-4b58-a769-df416ec379d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3918fd6-a419-461e-bf9c-abdad8158a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[611be7b6-c846-4474-9c64-8bfcb3e48cc4]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3918fd6-a419-461e-bf9c-abdad8158a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1171807461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ad2cbca3547ef9b2ad2be3c0a9965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:39Z,use_quota=True,user_id='5c0297e031c04778806a0024fe185f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febb06c5-a02a-46db-b2d1-f2dc5dbbc0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febb06c5-a02a-46db-b2d1-f2dc5dbbc0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee185cb-af22-4ef0-a213-654ad9adacf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee185cb-af22-4ef0-a213-654ad9adacf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40', 'volume_name': 'volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc99980-308f-46af-8c4e-9b3f0d24c817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc99980-308f-46af-8c4e-9b3f0d24c817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dd8985-ea6e-4c37-a5e8-918fe77314e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:39 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Volume 2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40', 'volume_size': 1} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:39 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591" returned: 0 in 1.450s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:39 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591 Apr 21 21:02:39 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a Apr 21 21:02:39 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:39 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:39 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-70439ff9-6221-4f29-9ce5-79dc9b75f591" returned: 0 in 0.416s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-quobyte-70439ff9-6221-4f29-9ce5-79dc9b75f591" released by "delete_volume" :: held 1.907s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Created reservations ['dc3f55b7-f209-4e7f-855e-147b2eddcce0', 'f4c9ae8f-9384-486d-9b66-72e0a39d6260', 'cb5f78e3-0160-4e09-a7f6-082d279a3703', 'e088248f-10d9-4967-964b-6c2d3b71fccc'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:39 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:39 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:39 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a" returned: 0 in 0.617s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a, size 1024.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:02:39 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Converted 1024.00 MB image at 353.55 MB/s Apr 21 21:02:39 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 is being set with open permissions: ugo+rw Apr 21 21:02:39 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:39 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 Apr 21 21:02:39 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:40 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.486s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:40 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Deleted volume successfully. Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a3665792-9021-44cd-951f-fa242ee1fca8 tempest-CreateVolumesFromImageTest-961519088 None] Lock "cinder-70439ff9-6221-4f29-9ce5-79dc9b75f591-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:40 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743" returned: 0 in 0.459s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-56597151-330c-4dd2-bc9c-2e51f15a3743" released by "_copy_volume_from_snapshot" :: held 5.678s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-7b7cd4ac-a131-4932-a135-2275c9ef642a-56597151-330c-4dd2-bc9c-2e51f15a3743" released by "_create_volume_from_snapshot" :: held 5.704s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.730s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.380s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1099885586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d791901e-8040-498c-ac22-7c3e2eb03c71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:36Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Creating volume d791901e-8040-498c-ac22-7c3e2eb03c71 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:40 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:40 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 1073741824 Apr 21 21:02:40 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62ef7fd-aa83-480c-88b0-2e090da6dc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56597151-330c-4dd2-bc9c-2e51f15a3743', 'volume_size': 1, 'snapshot_id': '7b7cd4ac-a131-4932-a135-2275c9ef642a'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ca2036-4486-4db4-9f19-ee4083dfce61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:40 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Volume volume-56597151-330c-4dd2-bc9c-2e51f15a3743 (56597151-330c-4dd2-bc9c-2e51f15a3743): created successfully Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ca2036-4486-4db4-9f19-ee4083dfce61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (2aabf9a3-c3f1-414d-bf68-e22c3f025fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:40 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f3408d03-2478-4241-a9ce-9ef79605d81c tempest-VolumeDependencyTests-88289789 None] Created volume successfully. Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-7b7cd4ac-a131-4932-a135-2275c9ef642a-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-7b7cd4ac-a131-4932-a135-2275c9ef642a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-77eee95a-2c2b-43bd-a651-e4293352972a" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-77eee95a-2c2b-43bd-a651-e4293352972a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-7b7cd4ac-a131-4932-a135-2275c9ef642a" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-7b7cd4ac-a131-4932-a135-2275c9ef642a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Deleting offline snapshot 7b7cd4ac-a131-4932-a135-2275c9ef642a of volume 77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] snapshot_file for this snap is: volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6865e419-4b84-47a9-953c-bcd6f9851296]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:40 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a Apr 21 21:02:40 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:40 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:40 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 1073741824" returned: 0 in 0.588s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:41 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 Apr 21 21:02:41 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:41 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a" returned: 0 in 0.585s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77eee95a-2c2b-43bd-a651-e4293352972a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce5c83-b0cb-4192-a18c-293de2f5c03f]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:41 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a Apr 21 21:02:41 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:41 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71" returned: 0 in 0.470s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.167s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2133910025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676ed29d-e508-48bf-9832-e8fa5ae47fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:36Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Creating volume 676ed29d-e508-48bf-9832-e8fa5ae47fe4 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:41 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbd2e22-dea0-47c8-9f77-108010bf3f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d791901e-8040-498c-ac22-7c3e2eb03c71', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278ce648-2b26-4068-ac8e-af54c3550056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:41 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 1073741824 Apr 21 21:02:41 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:41 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume volume-d791901e-8040-498c-ac22-7c3e2eb03c71 (d791901e-8040-498c-ac22-7c3e2eb03c71): created successfully Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (278ce648-2b26-4068-ac8e-af54c3550056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (6cb9b78c-76b2-49f4-8d92-4e60c62d935d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:41 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1d7e6bb7-95b0-4c60-aaac-21e0e86a6b54 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created volume successfully. Apr 21 21:02:41 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a" returned: 0 in 0.574s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:41 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:41 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a Apr 21 21:02:41 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (a4aed528-5c43-41cb-a341-999ca22688f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ae12b2-e21f-4d12-95c5-ea6dc367f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:42 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ae12b2-e21f-4d12-95c5-ea6dc367f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154711715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfe1b2e-ea96-4d13-92aa-f0d75d473273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:42Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37f91d6-2ace-489d-be18-8fb30d16c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37f91d6-2ace-489d-be18-8fb30d16c357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e6f19d-488a-4ca3-ab91-8f22fde6f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e6f19d-488a-4ca3-ab91-8f22fde6f554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cfe1b2e-ea96-4d13-92aa-f0d75d473273', 'volume_name': 'volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16445f72-77c9-4066-90b0-57dda9594919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16445f72-77c9-4066-90b0-57dda9594919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ddf9b6-4eb5-4ee0-bc18-0527ec8745d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:42 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume 7cfe1b2e-ea96-4d13-92aa-f0d75d473273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273', 'volume_size': 1} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 1073741824" returned: 0 in 0.584s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:42 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 Apr 21 21:02:42 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a" returned: 0 in 0.564s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:42 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a Apr 21 21:02:42 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4" returned: 0 in 0.460s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.937s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024882695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d42b8e2-d99c-4d98-8b02-d54ddd1d4669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:37Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Creating volume 3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:42 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a19b7e-c833-4c81-a00e-e870ad1808bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94373ef1-abf0-4488-ad33-cda25394cd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:42 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 1073741824 Apr 21 21:02:42 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:42 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 (676ed29d-e508-48bf-9832-e8fa5ae47fe4): created successfully Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94373ef1-abf0-4488-ad33-cda25394cd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (690e52f1-9ae5-405c-a903-c2b5ba494311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:42 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-cb564c5a-fac2-45dc-927c-e3602f4a91a0 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created volume successfully. Apr 21 21:02:42 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a.7b7cd4ac-a131-4932-a135-2275c9ef642a" returned: 0 in 0.464s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-7b7cd4ac-a131-4932-a135-2275c9ef642a" released by "_delete_snapshot" :: held 2.249s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:42 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-77eee95a-2c2b-43bd-a651-e4293352972a" released by "delete_snapshot" :: held 2.267s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Created reservations ['29a322c4-18f4-45f0-be6b-80a8f94f58a8', 'a3d8b6aa-c29d-4393-ab49-2901284cd100', 'dd4875d0-5654-4097-b8f1-99704b3bac01', '4a0d0e95-0f6a-40fc-a763-6d42794a30b8'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:43 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Delete snapshot completed successfully. Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-15cf3e96-8f00-41f5-bd1e-e9bd784a1ac3 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-7b7cd4ac-a131-4932-a135-2275c9ef642a-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:43 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 1073741824" returned: 0 in 0.551s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:43 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 Apr 21 21:02:43 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:43 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669" returned: 0 in 0.437s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.392s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144482946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:37Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Creating volume f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:43 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ed6f2b-f196-48be-bc9c-4a2d9b9c5ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:43 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b 1073741824 Apr 21 21:02:43 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533949c4-2c09-4862-9afe-1eb74a5023c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:43 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 (3d42b8e2-d99c-4d98-8b02-d54ddd1d4669): created successfully Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533949c4-2c09-4862-9afe-1eb74a5023c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (e2d7ccdf-a2f6-4328-85aa-f0dbfc682326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:43 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3e9a27fd-23eb-43e8-b095-9cd9637a56f8 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created volume successfully. Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-77eee95a-2c2b-43bd-a651-e4293352972a-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-77eee95a-2c2b-43bd-a651-e4293352972a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-77eee95a-2c2b-43bd-a651-e4293352972a" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-77eee95a-2c2b-43bd-a651-e4293352972a" acquired by "delete_volume" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ba1b57-1f8c-437c-bc48-517008cd9673]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:43 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:43 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a Apr 21 21:02:43 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b 1073741824" returned: 0 in 0.590s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b Apr 21 21:02:44 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a" returned: 0 in 0.513s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a Apr 21 21:02:44 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b" returned: 0 in 0.451s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.259s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-927088607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46be56d0-a821-4c1f-99af-9ec671c8f722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='566bc34afc8d4c8aaafb85ca3aafa506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:37Z,use_quota=True,user_id='4123b28e7de84c57a031a6507ab94dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Creating volume 46be56d0-a821-4c1f-99af-9ec671c8f722 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:44 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3330e55a-80ba-4d55-97e8-f56ace086abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:44 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 1073741824 Apr 21 21:02:44 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62aea65c-4a7f-4d86-99ee-9de5a4f65e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:44 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b (f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b): created successfully Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62aea65c-4a7f-4d86-99ee-9de5a4f65e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (16f91692-2732-466b-a27f-a6bcf8491bf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:44 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-58a50729-3de4-4d9f-a7ba-de867da3f706 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created volume successfully. Apr 21 21:02:44 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-77eee95a-2c2b-43bd-a651-e4293352972a" returned: 0 in 0.456s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-77eee95a-2c2b-43bd-a651-e4293352972a" released by "delete_volume" :: held 1.007s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Created reservations ['60a073e9-03b0-430c-860e-6b99c38a11ed', 'c400d7db-9fc2-4318-bd90-19e7bc6dc3ab', '8383af33-3ed1-4fed-a86d-d48485eeb541', 'c57c84ed-a187-483b-8d9d-471434d3174e'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:44 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:44 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:44 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:45 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 1073741824" returned: 0 in 0.522s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:45 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 Apr 21 21:02:45 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:45 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.455s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Deleted volume successfully. Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-77a43522-5ed1-4a9e-a303-c755f78bf3d8 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-77eee95a-2c2b-43bd-a651-e4293352972a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:45 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722" returned: 0 in 0.451s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.377s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1171807461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ad2cbca3547ef9b2ad2be3c0a9965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:39Z,use_quota=True,user_id='5c0297e031c04778806a0024fe185f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Creating volume 2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:45 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9981f572-fd08-4263-9249-0a439c7440c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46be56d0-a821-4c1f-99af-9ec671c8f722', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ec6f12-fae2-4fd7-b1dc-6824302ffda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:45 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 1073741824 Apr 21 21:02:45 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:45 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Volume volume-46be56d0-a821-4c1f-99af-9ec671c8f722 (46be56d0-a821-4c1f-99af-9ec671c8f722): created successfully Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ec6f12-fae2-4fd7-b1dc-6824302ffda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:45 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Flow 'volume_create_manager' (a8525912-5661-4bc3-9dec-4e9389ace498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:45 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-cc033356-a091-4d4a-b89d-753c856ab762 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created volume successfully. Apr 21 21:02:46 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 1073741824" returned: 0 in 0.510s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:46 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 Apr 21 21:02:46 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (78c9884e-3db9-4ced-a00e-26f1f262ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f130cf8d-e74e-4414-9f83-b107f1cbdf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f130cf8d-e74e-4414-9f83-b107f1cbdf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-385276891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2894f25c-661d-4bb9-98d2-e87e27335467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb7f87a8014a3aa392312df4e5fc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:46Z,use_quota=True,user_id='6a339328ab7c4634af9ad8351549a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1404d50-5321-4b6d-b0c3-9c5d0f30d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1404d50-5321-4b6d-b0c3-9c5d0f30d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfad0ecd-2529-445a-91ef-e8dc94599161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfad0ecd-2529-445a-91ef-e8dc94599161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2894f25c-661d-4bb9-98d2-e87e27335467', 'volume_name': 'volume-2894f25c-661d-4bb9-98d2-e87e27335467', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b8a5d9-c38a-4b57-8fc5-2bebba92c29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31b8a5d9-c38a-4b57-8fc5-2bebba92c29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58791d0-3257-41ea-ac5a-49b57d9e7458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Volume 2894f25c-661d-4bb9-98d2-e87e27335467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2894f25c-661d-4bb9-98d2-e87e27335467', 'volume_size': 1} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-46be56d0-a821-4c1f-99af-9ec671c8f722-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-46be56d0-a821-4c1f-99af-9ec671c8f722-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-46be56d0-a821-4c1f-99af-9ec671c8f722" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-46be56d0-a821-4c1f-99af-9ec671c8f722" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd0bee6-6522-409d-a99c-c60522b9447e]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:46 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 Apr 21 21:02:46 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:46 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" returned: 0 in 0.447s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.590s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154711715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfe1b2e-ea96-4d13-92aa-f0d75d473273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:42Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Creating volume 7cfe1b2e-ea96-4d13-92aa-f0d75d473273 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:46 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27dd8985-ea6e-4c37-a5e8-918fe77314e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a16172-3ece-46f6-a261-e569ae62155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:46 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 1073741824 Apr 21 21:02:46 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:46 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Volume volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 (2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40): created successfully Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a16172-3ece-46f6-a261-e569ae62155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Flow 'volume_create_manager' (6e0e6aea-f2f0-4b58-a769-df416ec379d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:46 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f0c87877-23bb-47ea-bc3e-1e8671df9c3a tempest-SnapshotDependencyTests-50196833 None] Created volume successfully. Apr 21 21:02:46 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722" returned: 0 in 0.487s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:46 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:46 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722 Apr 21 21:02:46 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 1073741824" returned: 0 in 0.506s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:47 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 Apr 21 21:02:47 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-46be56d0-a821-4c1f-99af-9ec671c8f722" returned: 0 in 0.422s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-46be56d0-a821-4c1f-99af-9ec671c8f722" released by "delete_volume" :: held 0.932s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Created reservations ['28ea1dcd-9b52-4c94-94a8-461c0da93d52', 'b28c643d-8f5d-4055-8d59-4d3007f65d66', '420a2158-c969-4147-813b-90dcea233279', '239510f7-cf91-4107-9450-51bfcdc1c5cb'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:47 devstack sudo[90895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:47 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1126f67b-1952-4f0c-b344-250a5c9cfa83]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:47 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b Apr 21 21:02:47 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273" returned: 0 in 0.483s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-385276891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2894f25c-661d-4bb9-98d2-e87e27335467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb7f87a8014a3aa392312df4e5fc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:46Z,use_quota=True,user_id='6a339328ab7c4634af9ad8351549a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Creating volume 2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:47 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ddf9b6-4eb5-4ee0-bc18-0527ec8745d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc7c9bd-2b02-4644-8533-e963545a64b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:47 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 1073741824 Apr 21 21:02:47 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 (7cfe1b2e-ea96-4d13-92aa-f0d75d473273): created successfully Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc7c9bd-2b02-4644-8533-e963545a64b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:47 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (a4aed528-5c43-41cb-a341-999ca22688f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3254c12f-edc6-4d10-a96d-c77fb8d624c2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created volume successfully. Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:47 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.514s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:47 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Deleted volume successfully. Apr 21 21:02:47 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ce5898ff-72f8-482d-a041-e83e7307870e tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-46be56d0-a821-4c1f-99af-9ec671c8f722-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:48 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b" returned: 0 in 0.512s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:48 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b Apr 21 21:02:48 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:48 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 1073741824" returned: 0 in 0.597s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:48 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 Apr 21 21:02:48 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:48 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b" returned: 0 in 0.498s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b" released by "delete_volume" :: held 1.033s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created reservations ['19cc335c-e935-4114-ae4f-b2c2990fe17f', 'fce10a36-a94b-4b7b-8c01-7d4420e1a8cc', '30ded1ad-a42f-4017-9103-193006c0a03f', 'a91c2577-10a0-494d-ac7e-f6d7143cc798'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:48 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:48 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (3a0f3590-0c9f-4aa2-a2bf-2ac05099a537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550974da-b622-47f3-9fc1-5991a92a5cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550974da-b622-47f3-9fc1-5991a92a5cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234564074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c0e951-dfe4-4f47-89b8-c6907012ddc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6511844b-a180-479e-b9d2-a8e82da27c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6511844b-a180-479e-b9d2-a8e82da27c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f92049-30c6-4f7a-b9f5-f949403e0e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f92049-30c6-4f7a-b9f5-f949403e0e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c0e951-dfe4-4f47-89b8-c6907012ddc8', 'volume_name': 'volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebe6e79-12ba-40c9-b56b-c8f24ba93255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebe6e79-12ba-40c9-b56b-c8f24ba93255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b8fad-585b-41a4-a938-5f4685f1588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume d1c0e951-dfe4-4f47-89b8-c6907012ddc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8', 'volume_size': 1} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:48 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (bef9f6af-0018-4b88-a3d4-c7956432ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ba4587-ed18-40b9-be78-bd26b6836144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.996s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Creating offline snapshot 8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 of volume 2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58791d0-3257-41ea-ac5a-49b57d9e7458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2894f25c-661d-4bb9-98d2-e87e27335467', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbab7e0-1032-4f7b-b9a0-2cf8fd060ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a964d8c-dc69-4fa9-9f4b-c664fa51a82c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ba4587-ed18-40b9-be78-bd26b6836144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1977150522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746ebf0b-b401-4d91-966e-3377d58201d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a14faf-ffc1-48c7-ad26-57ca48f32271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a14faf-ffc1-48c7-ad26-57ca48f32271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909d8e7e-45d1-4fb8-a39d-b2b81f56e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (909d8e7e-45d1-4fb8-a39d-b2b81f56e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '746ebf0b-b401-4d91-966e-3377d58201d7', 'volume_name': 'volume-746ebf0b-b401-4d91-966e-3377d58201d7', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e73da1-c083-454a-8975-75b9081e6d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e73da1-c083-454a-8975-75b9081e6d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d194ce-ea46-4c4d-8eab-f37211256ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:48 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume 746ebf0b-b401-4d91-966e-3377d58201d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-746ebf0b-b401-4d91-966e-3377d58201d7', 'volume_size': 1} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:48 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Volume volume-2894f25c-661d-4bb9-98d2-e87e27335467 (2894f25c-661d-4bb9-98d2-e87e27335467): created successfully Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbab7e0-1032-4f7b-b9a0-2cf8fd060ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (78c9884e-3db9-4ced-a00e-26f1f262ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-04c553c3-d338-4068-bd92-d6322347fd72 tempest-VolumeDependencyTests-88289789 None] Created volume successfully. Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (d3f7f9b8-5ed5-423e-8c38-ab5e3664307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6372becc-1b7b-45df-8783-0f1d4e1b3cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 Apr 21 21:02:49 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6372becc-1b7b-45df-8783-0f1d4e1b3cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135871000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfd8326-37e8-4775-8086-981f6917e13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c03a75-a333-45c1-b094-495a1fa1838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c03a75-a333-45c1-b094-495a1fa1838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e513529c-00cd-4206-8b60-dcd3a55ee705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e513529c-00cd-4206-8b60-dcd3a55ee705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfd8326-37e8-4775-8086-981f6917e13c', 'volume_name': 'volume-ebfd8326-37e8-4775-8086-981f6917e13c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2d2103-bfae-4206-a852-48c3a6734461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2d2103-bfae-4206-a852-48c3a6734461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3cf8ad-a2ad-4afb-a53e-23d4c4d95950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume ebfd8326-37e8-4775-8086-981f6917e13c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfd8326-37e8-4775-8086-981f6917e13c', 'volume_size': 1} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:49 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.574s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:49 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Deleted volume successfully. Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9c9813ff-f5e7-4ed8-ad09-56960eab44f3 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-f8e4ca1b-fe51-4ca8-865b-543f2cfe2e5b-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (34240329-624f-4cd5-9d31-ba62d2dee0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f5aed4-f180-49f3-b3d2-e840dce29723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f5aed4-f180-49f3-b3d2-e840dce29723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1828281226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e97a76-1e76-4c2a-b11e-5333b1a2abc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec8ff7e-f773-435f-861a-df78630e143c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec8ff7e-f773-435f-861a-df78630e143c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e114df50-c638-4e82-bf82-ac7446901676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e114df50-c638-4e82-bf82-ac7446901676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e97a76-1e76-4c2a-b11e-5333b1a2abc5', 'volume_name': 'volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0bd9d4-c9e1-4d58-ab76-f8d0cd80e6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0bd9d4-c9e1-4d58-ab76-f8d0cd80e6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aaf0e1-cc8c-4fb8-a4f9-f242dd4c85ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume d7e97a76-1e76-4c2a-b11e-5333b1a2abc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5', 'volume_size': 1} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (6c3d08d3-7e67-479a-b3b6-704e7011a529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5066d0b0-9590-47b9-adf7-2a3c5b3f90d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5066d0b0-9590-47b9-adf7-2a3c5b3f90d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1464178762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301afb33-b7ff-49ae-bd92-597d0a18c0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad4d282-1252-41a4-99cd-4897e0ef5a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad4d282-1252-41a4-99cd-4897e0ef5a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e93b65-bdf8-4083-964a-9f9a8160b0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e93b65-bdf8-4083-964a-9f9a8160b0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301afb33-b7ff-49ae-bd92-597d0a18c0a1', 'volume_name': 'volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c51d6f7-88f8-4c9c-9bbc-e89a8f86a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c51d6f7-88f8-4c9c-9bbc-e89a8f86a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b39df4-eadf-4b4d-a334-d483522158ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume 301afb33-b7ff-49ae-bd92-597d0a18c0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1', 'volume_size': 1} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:49 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" returned: 0 in 0.613s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:49 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 1G Apr 21 21:02:49 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669" acquired by "delete_volume" :: waited 0.013s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d6c186-4328-4e7f-a2f5-fe37d51aee97]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (0074ab2d-a1a7-40ca-b2a0-0d7163ced1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f6d457-a8fc-4f7e-a53f-d833692f4294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f6d457-a8fc-4f7e-a53f-d833692f4294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1215153875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bfc060-0e15-46af-a6db-46eeb57b3c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6cb7f87a8014a3aa392312df4e5fc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2894f25c-661d-4bb9-98d2-e87e27335467,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:50Z,use_quota=True,user_id='6a339328ab7c4634af9ad8351549a74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8270ef-6ac4-4dba-8303-c799afda9361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8270ef-6ac4-4dba-8303-c799afda9361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6da4f28-cd53-498e-950a-bd704c1f1592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 Apr 21 21:02:49 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6da4f28-cd53-498e-950a-bd704c1f1592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b7bfc060-0e15-46af-a6db-46eeb57b3c24', 'volume_name': 'volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24', 'volume_size': 1, 'source_volid': '2894f25c-661d-4bb9-98d2-e87e27335467', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d5ecad-53b2-4777-b1d3-0214df4f69de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d5ecad-53b2-4777-b1d3-0214df4f69de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f244b3dc-5005-44f4-b084-17f51b491a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:49 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Volume b7bfc060-0e15-46af-a6db-46eeb57b3c24: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24', 'volume_size': 1, 'source_volid': '2894f25c-661d-4bb9-98d2-e87e27335467', 'source_volstatus': 'available'} Apr 21 21:02:49 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:50 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 1G" returned: 0 in 0.564s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:50 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 Apr 21 21:02:50 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:50 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669" returned: 0 in 0.493s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:50 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669 Apr 21 21:02:50 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:50 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" returned: 0 in 0.434s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:50 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 is being set with open permissions: ugo+rw Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:50 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 Apr 21 21:02:50 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:50 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669" returned: 0 in 0.422s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669" released by "delete_volume" :: held 0.943s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created reservations ['9b98820b-beac-493f-87f6-4edd025f5b0b', '087e13e7-3fd9-4763-80c3-af7343b8dbfb', 'a092839b-4f23-4008-b03e-13c22088d262', 'a9d45940-f457-4ffd-8e20-79094079cf60'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:50 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:50 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:50 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:51 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" returned: 0 in 0.427s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:51 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.info Apr 21 21:02:51 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:51 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.443s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:51 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Deleted volume successfully. Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-f83bc16a-4a30-48a0-b291-fd5b81ad90f4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-3d42b8e2-d99c-4d98-8b02-d54ddd1d4669-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:51 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.info" returned: 0 in 0.409s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:51 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.info is being set with open permissions: ugo+rw Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:51 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.info Apr 21 21:02:51 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-676ed29d-e508-48bf-9832-e8fa5ae47fe4-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-676ed29d-e508-48bf-9832-e8fa5ae47fe4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-676ed29d-e508-48bf-9832-e8fa5ae47fe4" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:51 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.info" returned: 0 in 0.428s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.992s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.145s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234564074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c0e951-dfe4-4f47-89b8-c6907012ddc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Creating volume d1c0e951-dfe4-4f47-89b8-c6907012ddc8 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:51 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:51 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4ab41702-7186-406c-91fe-832075291954 tempest-SnapshotDependencyTests-50196833 None] Create snapshot completed successfully Apr 21 21:02:51 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 1073741824 Apr 21 21:02:51 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-676ed29d-e508-48bf-9832-e8fa5ae47fe4" acquired by "delete_volume" :: waited 0.059s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa66da-1308-4877-b965-bd4652bd70bb]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:51 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:52 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 Apr 21 21:02:52 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Flow 'volume_create_manager' (34624020-2839-47d2-a9e3-dc7687871d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f38ca78-b6b5-4768-9e48-e48156c6997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f38ca78-b6b5-4768-9e48-e48156c6997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b3245b-9ebf-40e8-80df-aed44df5bb52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7ad2cbca3547ef9b2ad2be3c0a9965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:52Z,use_quota=True,user_id='5c0297e031c04778806a0024fe185f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e796cf3-f58e-40f0-ac2a-da342e127dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e796cf3-f58e-40f0-ac2a-da342e127dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bd066e-8bfe-4616-8cf9-11e15c14a65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bd066e-8bfe-4616-8cf9-11e15c14a65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82b3245b-9ebf-40e8-80df-aed44df5bb52', 'volume_name': 'volume-82b3245b-9ebf-40e8-80df-aed44df5bb52', 'volume_size': 1, 'snapshot_id': '8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a81a4a-450c-4d0b-a0c5-94d7d2bda712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a81a4a-450c-4d0b-a0c5-94d7d2bda712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32518033-cc49-4262-9678-d41667c20685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:52 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Volume 82b3245b-9ebf-40e8-80df-aed44df5bb52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82b3245b-9ebf-40e8-80df-aed44df5bb52', 'volume_size': 1, 'snapshot_id': '8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68'} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:52 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 1073741824" returned: 0 in 0.556s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:52 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4" returned: 0 in 0.543s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:52 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 Apr 21 21:02:52 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:52 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4 Apr 21 21:02:52 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:52 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8" returned: 0 in 0.427s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.935s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1977150522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=746ebf0b-b401-4d91-966e-3377d58201d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Creating volume 746ebf0b-b401-4d91-966e-3377d58201d7 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:52 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:52 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd7b8fad-585b-41a4-a938-5f4685f1588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e7ffc5-d692-4c2b-86ca-bfd0a185a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:52 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 1073741824 Apr 21 21:02:52 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-676ed29d-e508-48bf-9832-e8fa5ae47fe4" returned: 0 in 0.457s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:52 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 (d1c0e951-dfe4-4f47-89b8-c6907012ddc8): created successfully Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e7ffc5-d692-4c2b-86ca-bfd0a185a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (3a0f3590-0c9f-4aa2-a2bf-2ac05099a537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:52 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-676ed29d-e508-48bf-9832-e8fa5ae47fe4" released by "delete_volume" :: held 1.039s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:52 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-2b6e35c2-84b2-4384-8059-53faa8060846 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created volume successfully. Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Created reservations ['722683a0-3284-4ff0-a825-40af2516b903', 'a9662610-8c84-43e8-bdd5-1bb063b272f4', '1917d35f-2882-437c-9ea5-be10668eea03', '479de031-d0b9-45ea-be00-97daad5ea331'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:53 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:53 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:53 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 1073741824" returned: 0 in 0.519s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:53 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 Apr 21 21:02:53 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:53 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.448s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Deleted volume successfully. Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-0651be36-e33d-4c1b-94cb-aa6e34b732ac tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-676ed29d-e508-48bf-9832-e8fa5ae47fe4-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:53 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7" returned: 0 in 0.442s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.782s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135871000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfd8326-37e8-4775-8086-981f6917e13c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Creating volume ebfd8326-37e8-4775-8086-981f6917e13c {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:53 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d194ce-ea46-4c4d-8eab-f37211256ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-746ebf0b-b401-4d91-966e-3377d58201d7', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94f7b4e-1d8b-4150-868f-9df3a0eaf0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:53 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c 1073741824 Apr 21 21:02:53 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:53 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume volume-746ebf0b-b401-4d91-966e-3377d58201d7 (746ebf0b-b401-4d91-966e-3377d58201d7): created successfully Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94f7b4e-1d8b-4150-868f-9df3a0eaf0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:53 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (bef9f6af-0018-4b88-a3d4-c7956432ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:53 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5b81b5d6-96b5-42c0-852b-5a6a4186000c tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created volume successfully. Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-d791901e-8040-498c-ac22-7c3e2eb03c71-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-d791901e-8040-498c-ac22-7c3e2eb03c71-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-d791901e-8040-498c-ac22-7c3e2eb03c71" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-d791901e-8040-498c-ac22-7c3e2eb03c71" acquired by "delete_volume" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb480669-161c-4eda-8498-4b4872784e1c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:54 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 Apr 21 21:02:54 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:54 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c 1073741824" returned: 0 in 0.510s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:54 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c Apr 21 21:02:54 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:54 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71" returned: 0 in 0.535s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:54 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71 Apr 21 21:02:54 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:54 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c" returned: 0 in 0.448s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.537s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1828281226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e97a76-1e76-4c2a-b11e-5333b1a2abc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Creating volume d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:54 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3cf8ad-a2ad-4afb-a53e-23d4c4d95950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfd8326-37e8-4775-8086-981f6917e13c', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:54 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 1073741824 Apr 21 21:02:54 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9cbc60-b706-40f9-b7f2-0cac8bcce5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:54 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume volume-ebfd8326-37e8-4775-8086-981f6917e13c (ebfd8326-37e8-4775-8086-981f6917e13c): created successfully Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c9cbc60-b706-40f9-b7f2-0cac8bcce5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:54 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (d3f7f9b8-5ed5-423e-8c38-ab5e3664307e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:54 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-4248d579-67ad-4ff5-9c80-61a89034506f tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created volume successfully. Apr 21 21:02:55 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d791901e-8040-498c-ac22-7c3e2eb03c71" returned: 0 in 0.423s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-d791901e-8040-498c-ac22-7c3e2eb03c71" released by "delete_volume" :: held 0.996s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created reservations ['283e4c35-a926-4db9-9636-a6a5ad86d7a5', '4947873f-d4e0-48fd-a117-d4debeb12a12', 'a9dc9e75-f78b-414e-b141-4bf40a2860c3', 'ffb6799d-eccc-4d26-9480-2b62bb5701ce'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:55 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:55 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:55 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 1073741824" returned: 0 in 0.476s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:55 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 Apr 21 21:02:55 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:55 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.437s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:55 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Deleted volume successfully. Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ac01f924-805f-4f4b-97db-22ecdf511215 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-d791901e-8040-498c-ac22-7c3e2eb03c71-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:55 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5" returned: 0 in 0.432s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.357s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1464178762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301afb33-b7ff-49ae-bd92-597d0a18c0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60e22414ed714306956e0c6fea3ba5c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:02:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:02:49Z,use_quota=True,user_id='0067a6c13ec843d684958171780e5f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Creating volume 301afb33-b7ff-49ae-bd92-597d0a18c0a1 {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:02:55 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7aaf0e1-cc8c-4fb8-a4f9-f242dd4c85ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:55 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 1073741824 Apr 21 21:02:55 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e3038a-4900-4d7a-a8b9-2eff4c640e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:55 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 (d7e97a76-1e76-4c2a-b11e-5333b1a2abc5): created successfully Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e3038a-4900-4d7a-a8b9-2eff4c640e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:55 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (34240329-624f-4cd5-9d31-ba62d2dee0dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:55 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5e2fe527-092f-4658-a830-13acefa875c0 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created volume successfully. Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-31608b65-8beb-46b2-860d-f2db5ba9912b-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-31608b65-8beb-46b2-860d-f2db5ba9912b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-04652550-d0ef-47bb-a39c-7d046d437f78" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-04652550-d0ef-47bb-a39c-7d046d437f78" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-31608b65-8beb-46b2-860d-f2db5ba9912b" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-31608b65-8beb-46b2-860d-f2db5ba9912b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Deleting offline snapshot 31608b65-8beb-46b2-860d-f2db5ba9912b of volume 04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] snapshot_file for this snap is: volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16bcbd-247d-4026-86a2-41ef6a7ee48d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:56 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b Apr 21 21:02:56 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:56 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 1073741824" returned: 0 in 0.513s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:56 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 Apr 21 21:02:56 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:56 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b" returned: 0 in 0.497s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04652550-d0ef-47bb-a39c-7d046d437f78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7119d6-8ce7-467a-ad93-89549b458b68]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:56 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 Apr 21 21:02:56 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:56 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1" returned: 0 in 0.441s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.016s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:56 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Cloning volume 2894f25c-661d-4bb9-98d2-e87e27335467 to volume b7bfc060-0e15-46af-a6db-46eeb57b3c24 Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b39df4-eadf-4b4d-a334-d483522158ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7301369d-54af-432d-bdff-56deb504e520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Creating offline snapshot c433e889-0684-4378-9dc9-11ede0a11c5f of volume 2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:02:56 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Volume volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 (301afb33-b7ff-49ae-bd92-597d0a18c0a1): created successfully Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7301369d-54af-432d-bdff-56deb504e520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Flow 'volume_create_manager' (6c3d08d3-7e67-479a-b3b6-704e7011a529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddecb853-f88b-43b9-b7b8-b7b9bab1b36d]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:56 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-64323580-9e02-4af8-90de-19b370f43600 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created volume successfully. Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-301afb33-b7ff-49ae-bd92-597d0a18c0a1-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:56 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 Apr 21 21:02:56 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:56 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-301afb33-b7ff-49ae-bd92-597d0a18c0a1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-quobyte-301afb33-b7ff-49ae-bd92-597d0a18c0a1" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-301afb33-b7ff-49ae-bd92-597d0a18c0a1" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8635f09a-d981-4279-85ba-85bd29b36a27]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:57 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 Apr 21 21:02:57 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:57 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78" returned: 0 in 0.517s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:57 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b Apr 21 21:02:57 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:57 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467" returned: 0 in 0.545s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:57 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f 1G Apr 21 21:02:57 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:57 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1" returned: 0 in 0.504s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:57 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1 Apr 21 21:02:57 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:57 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b" returned: 0 in 0.467s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:57 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b Apr 21 21:02:57 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:57 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f 1G" returned: 0 in 0.502s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2894f25c-661d-4bb9-98d2-e87e27335467 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:57 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2894f25c-661d-4bb9-98d2-e87e27335467 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f Apr 21 21:02:57 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:57 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:57 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-301afb33-b7ff-49ae-bd92-597d0a18c0a1" returned: 0 in 0.430s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-301afb33-b7ff-49ae-bd92-597d0a18c0a1" released by "delete_volume" :: held 0.958s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created reservations ['d17e591d-b4a0-4f92-8eae-33ac056c7902', 'af676dde-7816-48f2-be18-1fa5a197dcb1', '7663342d-e8ae-4512-9792-7038e28d48b4', 'b98cd7f6-2bbf-4be2-afb3-38bc26add548'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:58 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:58 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:58 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78.31608b65-8beb-46b2-860d-f2db5ba9912b" returned: 0 in 0.480s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-quobyte-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-31608b65-8beb-46b2-860d-f2db5ba9912b" released by "_delete_snapshot" :: held 2.029s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-04652550-d0ef-47bb-a39c-7d046d437f78" released by "delete_snapshot" :: held 2.046s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5" acquired by "delete_volume" :: waited 0.027s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e681f8c-fc08-48de-b117-726a8e178779]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created reservations ['8ff58840-79b2-43f8-84c3-b20f9371a5ca', 'ef7b5b9f-82d6-410c-a4ee-1b4063610425', 'b1225224-8eae-4555-b038-6e359ff42556', '10edc49b-f439-4352-9e26-26f14e5e0583'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:58 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Delete snapshot completed successfully. Apr 21 21:02:58 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 Apr 21 21:02:58 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-a95a7c28-5e41-4ace-b07a-0afe8d3d8641 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-31608b65-8beb-46b2-860d-f2db5ba9912b-delete_snapshot" released by "delete_snapshot" :: held 2.167s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:58 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2894f25c-661d-4bb9-98d2-e87e27335467 -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f" returned: 0 in 0.512s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:58 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f is being set with open permissions: ugo+rw Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:58 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f Apr 21 21:02:58 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:58 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.457s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:58 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Deleted volume successfully. Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d876a1ae-4f44-481b-8984-2c8790905503 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-301afb33-b7ff-49ae-bd92-597d0a18c0a1-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:58 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5" returned: 0 in 0.500s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:58 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5 Apr 21 21:02:58 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:58 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:58 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:58 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.info Apr 21 21:02:58 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:59 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5" returned: 0 in 0.443s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5" released by "delete_volume" :: held 0.968s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created reservations ['2187edcc-7179-4a23-93bf-e61e0fe42246', '75bb521f-a0c5-4347-8e96-e4dc1710e788', 'f9facefc-e9bd-4cb4-8e25-abe20b66808c', '402cdc17-5f06-4351-9104-b0173f91d7a0'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:59 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-04652550-d0ef-47bb-a39c-7d046d437f78-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:59 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-04652550-d0ef-47bb-a39c-7d046d437f78-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:59 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.info" returned: 0 in 0.459s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:59 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.info is being set with open permissions: ugo+rw Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:59 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.info Apr 21 21:02:59 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "cinder-quobyte-04652550-d0ef-47bb-a39c-7d046d437f78" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-04652550-d0ef-47bb-a39c-7d046d437f78" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb0724-87e3-4208-82bc-9bdadeb13df1]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:59 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 Apr 21 21:02:59 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:59 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.439s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:02:59 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Deleted volume successfully. Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-ca10e564-784d-4ae5-8e02-1bce4b138367 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-d7e97a76-1e76-4c2a-b11e-5333b1a2abc5-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:02:59 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.info" returned: 0 in 0.413s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-b7bfc060-0e15-46af-a6db-46eeb57b3c24" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-b7bfc060-0e15-46af-a6db-46eeb57b3c24" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] snapshot: c433e889-0684-4378-9dc9-11ede0a11c5f, volume: b7bfc060-0e15-46af-a6db-46eeb57b3c24, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc706581-5c22-4e20-86a9-b966a5485ce5]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:59 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f Apr 21 21:02:59 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:02:59 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:02:59 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:02:59 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78 Apr 21 21:02:59 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:00 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f" returned: 0 in 0.498s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2894f25c-661d-4bb9-98d2-e87e27335467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e71e733-8dfb-495d-8a13-b42a4bf55ae8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-ebfd8326-37e8-4775-8086-981f6917e13c-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-ebfd8326-37e8-4775-8086-981f6917e13c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-quobyte-ebfd8326-37e8-4775-8086-981f6917e13c" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-ebfd8326-37e8-4775-8086-981f6917e13c" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:00 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 Apr 21 21:03:00 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:00 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-04652550-d0ef-47bb-a39c-7d046d437f78" returned: 0 in 0.465s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b92d0e6-bbdb-46c6-bdfd-1abf49375f93]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-quobyte-04652550-d0ef-47bb-a39c-7d046d437f78" released by "delete_volume" :: held 1.003s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Created reservations ['ed7cb1a0-e306-446c-80f1-41f38559fd8a', 'dabc50cf-46c8-4898-8a04-a4536f98f5a4', '68676122-cecf-4b7c-adaa-b2269e806d83', '3b175e3e-7fbe-4e05-9915-5bec46108cf6'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:00 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c Apr 21 21:03:00 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:00 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:00 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:00 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467" returned: 0 in 0.494s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:00 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 Apr 21 21:03:00 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:00 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c" returned: 0 in 0.507s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:00 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:00 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c Apr 21 21:03:00 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.433s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:00 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Deleted volume successfully. Apr 21 21:03:00 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-50272b12-e8e7-4eb7-81f4-3d26a2356cc4 tempest-CreateVolumesFromSnapshotTest-250389097 None] Lock "cinder-04652550-d0ef-47bb-a39c-7d046d437f78-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:01 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-ebfd8326-37e8-4775-8086-981f6917e13c" returned: 0 in 0.589s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-ebfd8326-37e8-4775-8086-981f6917e13c" released by "delete_volume" :: held 1.137s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created reservations ['ce33a442-acf4-4ce6-9912-1e814125832f', '02854a35-3777-434b-8763-caf5f24cfb4b', '9435baa3-92b8-4e18-b5aa-57cd8e154f4f', '29a57ca1-b057-47d5-a970-981cf926d068'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:01 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:01 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:01 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG oslo_service.periodic_task [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82362) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:02 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:02 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-746ebf0b-b401-4d91-966e-3377d58201d7-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-746ebf0b-b401-4d91-966e-3377d58201d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-quobyte-746ebf0b-b401-4d91-966e-3377d58201d7" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-746ebf0b-b401-4d91-966e-3377d58201d7" acquired by "delete_volume" :: waited 0.029s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7e7fcb-c050-49b3-a1b2-9f85e694fae9]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:02 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:03 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 Apr 21 21:03:03 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:03 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24" returned: 0 in 2.519s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f61d0b-977c-49b5-9a60-1005d365bc3c]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:03 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 1.450s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:03 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Deleted volume successfully. Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-3dcef349-0e05-4f47-a667-1ecf8062e372 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-ebfd8326-37e8-4775-8086-981f6917e13c-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:03 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 Apr 21 21:03:03 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:03 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 1.091s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5f9bbd83-a7b8-4712-a5cc-3c9a4f5f279a None None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:03 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7" returned: 0 in 0.811s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:03 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:03 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7 Apr 21 21:03:03 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:04 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467" returned: 0 in 0.691s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:03:04 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Converted 1024.00 MB image at 406.34 MB/s Apr 21 21:03:04 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 is being set with open permissions: ugo+rw Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:04 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 Apr 21 21:03:04 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:04 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-746ebf0b-b401-4d91-966e-3377d58201d7" returned: 0 in 0.441s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-746ebf0b-b401-4d91-966e-3377d58201d7" released by "delete_volume" :: held 1.297s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created reservations ['1fb08b3e-693a-4ae5-9711-1c8fc7bb8518', '904b3154-466d-47fc-95a1-eba4aba421d6', '9c8b522a-1ed2-4f50-9e91-8f5c21c3d9bd', 'df3be9f7-18b4-45c3-ba49-ae7a6101d196'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:04 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:04 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:04 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24" returned: 0 in 0.464s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-b7bfc060-0e15-46af-a6db-46eeb57b3c24" released by "_copy_volume_from_snapshot" :: held 4.714s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-c433e889-0684-4378-9dc9-11ede0a11c5f" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-c433e889-0684-4378-9dc9-11ede0a11c5f" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Deleting offline snapshot c433e889-0684-4378-9dc9-11ede0a11c5f of volume 2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] snapshot_file for this snap is: volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a3297-85dc-400e-8e5c-7486b63755e0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:04 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f Apr 21 21:03:04 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:04 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.407s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:04 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Deleted volume successfully. Apr 21 21:03:04 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-331ef12c-7f72-4938-b89d-2405e04e8096 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-746ebf0b-b401-4d91-966e-3377d58201d7-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:05 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f" returned: 0 in 0.467s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2894f25c-661d-4bb9-98d2-e87e27335467(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d067dc-fbbf-4132-b559-20ab6f3c89e0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:05 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 Apr 21 21:03:05 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-d1c0e951-dfe4-4f47-89b8-c6907012ddc8-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-d1c0e951-dfe4-4f47-89b8-c6907012ddc8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-quobyte-d1c0e951-dfe4-4f47-89b8-c6907012ddc8" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-d1c0e951-dfe4-4f47-89b8-c6907012ddc8" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[899c8380-b8f9-4234-99f0-d2226d598f3a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:05 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 Apr 21 21:03:05 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:05 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467" returned: 0 in 0.499s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:05 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f Apr 21 21:03:05 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:05 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8" returned: 0 in 0.464s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:05 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8 Apr 21 21:03:05 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:05 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f" returned: 0 in 0.457s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:05 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:06 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f Apr 21 21:03:06 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:06 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-d1c0e951-dfe4-4f47-89b8-c6907012ddc8" returned: 0 in 0.423s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-d1c0e951-dfe4-4f47-89b8-c6907012ddc8" released by "delete_volume" :: held 0.910s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created reservations ['9baee889-efe9-4871-8b82-2e4d76da930b', 'b8aaa68d-ccdd-48fe-aa38-684abdbba3ab', 'fc9905d2-2bff-4fc6-81a2-edfcd5e207e7', '77ad148c-da19-4e7c-b1c9-ff7e8d7fafdd'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:06 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:06 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-7cfe1b2e-ea96-4d13-92aa-f0d75d473273-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-7cfe1b2e-ea96-4d13-92aa-f0d75d473273-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "cinder-quobyte-7cfe1b2e-ea96-4d13-92aa-f0d75d473273" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-7cfe1b2e-ea96-4d13-92aa-f0d75d473273" acquired by "delete_volume" :: waited 0.021s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a4b949-265d-4dd7-a53a-0ad48187e1f2]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:06 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 Apr 21 21:03:06 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:06 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467.c433e889-0684-4378-9dc9-11ede0a11c5f" returned: 0 in 0.457s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-c433e889-0684-4378-9dc9-11ede0a11c5f" released by "_delete_snapshot" :: held 1.926s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.637s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.029s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-quobyte-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68-82b3245b-9ebf-40e8-80df-aed44df5bb52" by "_create_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f244b3dc-5005-44f4-b084-17f51b491a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24', 'volume_size': 1, 'source_volid': '2894f25c-661d-4bb9-98d2-e87e27335467', 'source_volstatus': 'available'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf27a8d-4d4e-405a-84a3-ece81cde0be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:06 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Volume volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 (b7bfc060-0e15-46af-a6db-46eeb57b3c24): created successfully Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf27a8d-4d4e-405a-84a3-ece81cde0be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Flow 'volume_create_manager' (0074ab2d-a1a7-40ca-b2a0-0d7163ced1ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68-82b3245b-9ebf-40e8-80df-aed44df5bb52" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Creating volume 82b3245b-9ebf-40e8-80df-aed44df5bb52 from snapshot 8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-quobyte-82b3245b-9ebf-40e8-80df-aed44df5bb52" by "_copy_volume_from_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-d1d2bb8a-600e-40b4-945b-a076de535034 tempest-VolumeDependencyTests-88289789 None] Created volume successfully. Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-82b3245b-9ebf-40e8-80df-aed44df5bb52" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] snapshot: 8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68, volume: 82b3245b-9ebf-40e8-80df-aed44df5bb52, {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1505ae-4b54-4bdd-9549-9edbfd84a252]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-2894f25c-661d-4bb9-98d2-e87e27335467-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-2894f25c-661d-4bb9-98d2-e87e27335467-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:06 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 Apr 21 21:03:06 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-2894f25c-661d-4bb9-98d2-e87e27335467" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-2894f25c-661d-4bb9-98d2-e87e27335467" acquired by "delete_volume" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56a2870-98c2-4bde-80a7-2ab7eed7ecb3]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:06 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.532s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:06 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Deleted volume successfully. Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-c8d375c9-38fd-4a07-bc27-0794af82cbd2 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-d1c0e951-dfe4-4f47-89b8-c6907012ddc8-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:06 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 Apr 21 21:03:06 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:06 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273" returned: 0 in 0.553s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:06 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:06 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273 Apr 21 21:03:06 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:07 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" returned: 0 in 0.484s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Creating direct copy from snapshot {{(pid=82362) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[816d78c1-215c-4788-8cad-1029e018d5e8]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:07 devstack sudo[91192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 Apr 21 21:03:07 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:07 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467" returned: 0 in 0.501s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:07 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467 Apr 21 21:03:07 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:07 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-7cfe1b2e-ea96-4d13-92aa-f0d75d473273" returned: 0 in 0.414s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-quobyte-7cfe1b2e-ea96-4d13-92aa-f0d75d473273" released by "delete_volume" :: held 0.994s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Created reservations ['cce5533c-e595-47d1-9430-193bc282eac4', 'f86081ae-acc8-4a02-a437-717270a4a38b', '02ce1cc6-c05b-4586-b698-4bb5f4b9490c', '4364a657-a049-4970-9d22-c889a8b01b06'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:07 devstack sudo[91200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:07 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:07 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" returned: 0 in 0.513s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.utils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Path /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 not found in is_blk_device check {{(pid=82362) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:07 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 Apr 21 21:03:07 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:07 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2894f25c-661d-4bb9-98d2-e87e27335467" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-2894f25c-661d-4bb9-98d2-e87e27335467" released by "delete_volume" :: held 0.965s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Created reservations ['56e066ea-0ae8-4aa8-a83b-657a045ea37b', '13257fcb-ecce-4218-9705-7633b1f3627e', 'd5d19756-3f3e-4769-b3a6-c62faa9b94e6', '15f5270c-310c-478f-b2cd-f73588c2b89d'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:07 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:07 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:07 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.459s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:07 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Deleted volume successfully. Apr 21 21:03:07 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-39a6c10e-18c9-4c39-b4cb-a5495c456702 tempest-CreateVolumesFromSourceVolumeTest-1633317256 None] Lock "cinder-7cfe1b2e-ea96-4d13-92aa-f0d75d473273-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:08 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:08 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.736s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:08 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:08 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Deleted volume successfully. Apr 21 21:03:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-164aec25-b050-46e2-9c1c-08d175e83b52 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-2894f25c-661d-4bb9-98d2-e87e27335467-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-b7bfc060-0e15-46af-a6db-46eeb57b3c24-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:08 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-b7bfc060-0e15-46af-a6db-46eeb57b3c24-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-b7bfc060-0e15-46af-a6db-46eeb57b3c24" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:09 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-b7bfc060-0e15-46af-a6db-46eeb57b3c24" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:09 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b34a85-88b6-4135-9ce0-1ec891a2b074]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:09 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 Apr 21 21:03:09 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:09 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52" returned: 0 in 2.329s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:09 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4344f0-e2ce-4cea-b770-242654522d3a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:09 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:10 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 Apr 21 21:03:10 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:10 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24" returned: 0 in 1.080s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:10 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24 Apr 21 21:03:10 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:10 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" returned: 0 in 0.678s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG cinder.image.image_utils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Image conversion details: src /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 {{(pid=82362) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:03:10 devstack cinder-volume[82362]: INFO cinder.image.image_utils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Converted 1024.00 MB image at 439.30 MB/s Apr 21 21:03:10 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 is being set with open permissions: ugo+rw Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:10 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 Apr 21 21:03:10 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:10 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-b7bfc060-0e15-46af-a6db-46eeb57b3c24" returned: 0 in 0.495s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-b7bfc060-0e15-46af-a6db-46eeb57b3c24" released by "delete_volume" :: held 1.640s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Created reservations ['749a60f8-db69-481d-bf17-3ed5290789dd', '3230f742-7b1a-4721-84e4-66fca70cc1c6', '8f51bf18-5b04-4046-b021-96d1b4d00e3b', '61e36bdb-d053-493f-bb4f-ba8cb6816739'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:10 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:10 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:10 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:11 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52" returned: 0 in 0.468s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Flow 'volume_create_manager' (5e9618df-7348-4887-8f39-98338e3311f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7359eb1-c994-46f4-93e8-7a84f7430916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-82b3245b-9ebf-40e8-80df-aed44df5bb52" released by "_copy_volume_from_snapshot" :: held 4.580s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7359eb1-c994-46f4-93e8-7a84f7430916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b5aadf-4d75-4faf-979d-30e45539ed3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c79537518f43489a781a9d3423f45f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:03:11Z,use_quota=True,user_id='2ef88924249549e4bfaf5d9279d0520e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76908181-9526-4519-b9c9-819a34cd731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76908181-9526-4519-b9c9-819a34cd731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b92b0a-44b5-484f-a30d-8b1dfbd10f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b92b0a-44b5-484f-a30d-8b1dfbd10f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b5aadf-4d75-4faf-979d-30e45539ed3e', 'volume_name': 'volume-39b5aadf-4d75-4faf-979d-30e45539ed3e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f16000-534c-4a37-afa6-8fe2d32d6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f16000-534c-4a37-afa6-8fe2d32d6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12c2ca4-0769-46f0-a293-5cf04882cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:11 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Volume 39b5aadf-4d75-4faf-979d-30e45539ed3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b5aadf-4d75-4faf-979d-30e45539ed3e', 'volume_size': 1} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68-82b3245b-9ebf-40e8-80df-aed44df5bb52" released by "_create_volume_from_snapshot" :: held 4.641s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.672s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b5aadf-4d75-4faf-979d-30e45539ed3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c79537518f43489a781a9d3423f45f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:03:11Z,use_quota=True,user_id='2ef88924249549e4bfaf5d9279d0520e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Creating volume 39b5aadf-4d75-4faf-979d-30e45539ed3e {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:03:11 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:11 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e 1073741824 Apr 21 21:03:11 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32518033-cc49-4262-9678-d41667c20685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b3245b-9ebf-40e8-80df-aed44df5bb52', 'volume_size': 1, 'snapshot_id': '8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68'}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f88b12a-5e71-47d4-a107-f34b6280903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:11 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Volume volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 (82b3245b-9ebf-40e8-80df-aed44df5bb52): created successfully Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f88b12a-5e71-47d4-a107-f34b6280903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Flow 'volume_create_manager' (34624020-2839-47d2-a9e3-dc7687871d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:03:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-123988c5-e868-4be1-9074-eb65b35d8309 tempest-SnapshotDependencyTests-50196833 None] Created volume successfully. Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-56597151-330c-4dd2-bc9c-2e51f15a3743-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:11 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-56597151-330c-4dd2-bc9c-2e51f15a3743-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.487s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:11 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Deleted volume successfully. Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "cinder-quobyte-56597151-330c-4dd2-bc9c-2e51f15a3743" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-9827fa99-810c-48d8-827e-ea604c5fa441 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-b7bfc060-0e15-46af-a6db-46eeb57b3c24-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-56597151-330c-4dd2-bc9c-2e51f15a3743" acquired by "delete_volume" :: waited 0.008s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[27192033-3933-4251-afaf-6d1381368ced]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:11 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 Apr 21 21:03:11 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:11 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e 1073741824" returned: 0 in 0.557s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:11 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e Apr 21 21:03:11 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-quobyte-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-quobyte-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:11 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Deleting offline snapshot 8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 of volume 2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] snapshot_file for this snap is: volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743" returned: 0 in 0.524s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa436003-ddf4-4119-a585-38ccdccd43c9]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:11 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:11 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743 Apr 21 21:03:11 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:11 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 Apr 21 21:03:11 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:12 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e" returned: 0 in 0.454s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12c2ca4-0769-46f0-a293-5cf04882cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b5aadf-4d75-4faf-979d-30e45539ed3e', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7045bb22-bc8a-440e-bb2b-58a6b45c15a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:12 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Volume volume-39b5aadf-4d75-4faf-979d-30e45539ed3e (39b5aadf-4d75-4faf-979d-30e45539ed3e): created successfully Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7045bb22-bc8a-440e-bb2b-58a6b45c15a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Flow 'volume_create_manager' (5e9618df-7348-4887-8f39-98338e3311f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:03:12 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-c30b1a45-7e42-4840-86f8-dd27cdb26a4e tempest-CinderUnicodeTest-1152892299 None] Created volume successfully. Apr 21 21:03:12 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-56597151-330c-4dd2-bc9c-2e51f15a3743" returned: 0 in 0.433s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-quobyte-56597151-330c-4dd2-bc9c-2e51f15a3743" released by "delete_volume" :: held 0.981s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Created reservations ['f9462c61-beda-4c82-b221-5204a2a810b1', '0ee1a0b7-1959-4fa7-8606-9637b0f90914', '7bc5f733-14b1-4150-9a4c-493815fc6897', 'a09925f1-f563-4c98-bca6-7b86643cb3bb'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:12 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" returned: 0 in 0.506s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32bbcef-aa01-4818-8dae-f7aaa13b8b2a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:12 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:12 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:12 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 Apr 21 21:03:12 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:12 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.496s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:12 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Deleted volume successfully. Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-94ef5254-e364-4153-ad9b-353822fb9749 tempest-VolumeDependencyTests-88289789 None] Lock "cinder-56597151-330c-4dd2-bc9c-2e51f15a3743-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:12 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" returned: 0 in 0.534s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:12 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:12 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 Apr 21 21:03:12 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82362) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:03:13 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Flow 'volume_create_manager' (c6739a52-85f3-4afd-8a7b-091a1f7bfc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a8b95e-d17a-45a3-9269-ba2b8fbdb7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a8b95e-d17a-45a3-9269-ba2b8fbdb7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:03:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-784592007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3f632-dc2c-48b1-9d04-a869ff03f1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c79537518f43489a781a9d3423f45f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:03:14Z,use_quota=True,user_id='2ef88924249549e4bfaf5d9279d0520e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0126880-92a5-40d8-9424-35bb61669a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0126880-92a5-40d8-9424-35bb61669a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904a9833-f931-420a-926e-d9bb5c5c1d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904a9833-f931-420a-926e-d9bb5c5c1d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab3f632-dc2c-48b1-9d04-a869ff03f1ea', 'volume_name': 'volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c00e57-bdd3-47e5-9841-bb97f0ce30a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c00e57-bdd3-47e5-9841-bb97f0ce30a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d940ca-01dc-4052-a6a0-18eac1607955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:13 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Volume 4ab3f632-dc2c-48b1-9d04-a869ff03f1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea', 'volume_size': 1} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:03:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-784592007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3f632-dc2c-48b1-9d04-a869ff03f1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c79537518f43489a781a9d3423f45f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:03:14Z,use_quota=True,user_id='2ef88924249549e4bfaf5d9279d0520e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721c76e3-cde2-4b7e-9c22-fef5885f427b),volume_type_id=721c76e3-cde2-4b7e-9c22-fef5885f427b)}" {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Creating volume 4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Selected osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 as target Quobyte volume. {{(pid=82362) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:03:13 devstack cinder-volume[82362]: INFO cinder.volume.drivers.remotefs [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] casted to osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3 Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea 1073741824 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" returned: 0 in 0.685s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:13 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:13 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea 1073741824 Apr 21 21:03:13 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:13 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68 Apr 21 21:03:13 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:14 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40.8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" returned: 0 in 0.441s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68" released by "_delete_snapshot" :: held 2.231s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" released by "delete_snapshot" :: held 2.241s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:14 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea 1073741824" returned: 0 in 0.510s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Created reservations ['ed62c15c-6428-4d2b-96eb-49baf75cdcd1', '84887830-f341-4e89-ae28-96fdc1d9b2b8', '38adc76e-b2c5-4d85-a116-2186f974b54e', 'b7f58c27-2eb5-489a-b13c-7d2171ffdb48'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:14 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea Apr 21 21:03:14 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:14 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Delete snapshot completed successfully. Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-1111d10a-10a2-4d6a-8634-9241f3bff0ac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-8956ae7d-fb9b-4ed4-9fdf-ee98077e2b68-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:14 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" returned: 0 in 0.429s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'} {{(pid=82362) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d940ca-01dc-4052-a6a0-18eac1607955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea', 'volume_size': 1}' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea08c69-b05c-4633-bf6c-7a1e3213db58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:03:14 devstack cinder-volume[82362]: INFO cinder.volume.flows.manager.create_volume [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Volume volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea (4ab3f632-dc2c-48b1-9d04-a869ff03f1ea): created successfully Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cea08c69-b05c-4633-bf6c-7a1e3213db58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82362) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Flow 'volume_create_manager' (c6739a52-85f3-4afd-8a7b-091a1f7bfc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82362) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:03:14 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-07a7322b-4a87-42af-b008-b1da20d556bf tempest-CinderUnicodeTest-1152892299 None] Created volume successfully. Apr 21 21:03:14 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-quobyte-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f203a8d-da17-43ce-b4fa-1c93602b4f7a]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:15 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 Apr 21 21:03:15 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:15 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" returned: 0 in 0.472s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:15 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40 Apr 21 21:03:15 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Creating offline snapshot 40a35e1e-fc53-471c-bebd-66e7b092d041 of volume 4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b004998-1b41-4b18-9587-153f21b151f9]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:15 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:15 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea Apr 21 21:03:15 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:16 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" returned: 0 in 0.481s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40" released by "delete_volume" :: held 0.984s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Created reservations ['0ddef118-3d55-4885-b394-75175ee22733', '1c90b0d8-6e85-4bc0-910a-abffea21ad5b', 'de34fdba-aca6-4167-a002-0c28267ed729', 'bbd637de-9faf-45fc-b03e-e11466c0fc66'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:16 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:16 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-82b3245b-9ebf-40e8-80df-aed44df5bb52-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-82b3245b-9ebf-40e8-80df-aed44df5bb52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "cinder-quobyte-82b3245b-9ebf-40e8-80df-aed44df5bb52" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-82b3245b-9ebf-40e8-80df-aed44df5bb52" acquired by "delete_volume" :: waited 0.006s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f6f0d-608c-4f14-82cb-2351982605f0]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:16 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 Apr 21 21:03:16 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:16 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" returned: 0 in 0.515s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 1G {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:16 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 1G Apr 21 21:03:16 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:16 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.452s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:16 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Deleted volume successfully. Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-5a136516-4bfe-48d4-afac-36fddb9a1aac tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-2e160c70-3b9f-4bfc-aa7e-e6842a8c2f40-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:16 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52" returned: 0 in 0.481s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:16 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52 Apr 21 21:03:16 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:16 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 1G" returned: 0 in 0.505s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:16 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:16 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 Apr 21 21:03:16 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:17 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-82b3245b-9ebf-40e8-80df-aed44df5bb52" returned: 0 in 0.425s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-quobyte-82b3245b-9ebf-40e8-80df-aed44df5bb52" released by "delete_volume" :: held 0.926s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Created reservations ['8d067e48-3885-4cbb-9841-fe9e1b5d9f47', 'f0b95e89-f943-4f4a-8e28-27a8ba8397d9', 'a0a9d88f-2f22-4d44-bfca-796ed9b0eeab', 'e0ad0f56-691f-4518-b150-4603960682fa'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:17 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:17 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:17 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea -F qcow2 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041" returned: 0 in 0.448s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:17 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 is being set with open permissions: ugo+rw Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:17 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 Apr 21 21:03:17 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:17 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.469s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:17 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Deleted volume successfully. Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-7be89acf-cdb9-4b3a-88e8-97ea9d7efdcd tempest-SnapshotDependencyTests-50196833 None] Lock "cinder-82b3245b-9ebf-40e8-80df-aed44df5bb52-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:17 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041" returned: 0 in 0.419s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:17 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:17 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.info Apr 21 21:03:17 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:18 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.info" returned: 0 in 0.460s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:18 devstack cinder-volume[82362]: WARNING cinder.volume.drivers.remotefs [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.info is being set with open permissions: ugo+rw Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.info {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:18 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.info Apr 21 21:03:18 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:18 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.info" returned: 0 in 0.446s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.847s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:18 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-3cd9f203-2b3b-4ee3-aee2-7f30d9054e34 tempest-CinderUnicodeTest-1152892299 None] Create snapshot completed successfully Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "cinder-40a35e1e-fc53-471c-bebd-66e7b092d041-delete_snapshot" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-40a35e1e-fc53-471c-bebd-66e7b092d041-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "cinder-quobyte-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" by "delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "cinder-quobyte-40a35e1e-fc53-471c-bebd-66e7b092d041" by "_delete_snapshot" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-40a35e1e-fc53-471c-bebd-66e7b092d041" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Deleting offline snapshot 40a35e1e-fc53-471c-bebd-66e7b092d041 of volume 4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] snapshot_file for this snap is: volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 {{(pid=82362) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cb4a96-8253-4fed-bae6-3bd907c4ad16]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:18 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:19 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 Apr 21 21:03:19 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:19 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041" returned: 0 in 0.518s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:19 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.remotefs [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82362) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:03:19 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fdeeb5-c09f-4d5b-9fb4-cb79bd878677]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:19 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:19 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea Apr 21 21:03:19 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:20 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" returned: 0 in 0.534s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:20 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 Apr 21 21:03:20 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:20 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041" returned: 0 in 0.485s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:20 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:20 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041 Apr 21 21:03:20 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:21 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:21 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea.40a35e1e-fc53-471c-bebd-66e7b092d041" returned: 0 in 0.480s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-40a35e1e-fc53-471c-bebd-66e7b092d041" released by "_delete_snapshot" :: held 2.078s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" released by "delete_snapshot" :: held 2.092s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:21 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Created reservations ['c6c41aef-1a6e-4cce-9c9f-896165fa74c0', 'ad44a233-0bd4-4f6d-a011-bfdcf4ccf6a3', '38a04cbc-fe9d-4306-b896-e574c69046b7', 'a9343378-4a7e-457b-a67a-8392ca31678a'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:21 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Delete snapshot completed successfully. Apr 21 21:03:21 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-59ea865d-7e36-4ca5-96e7-ed2f332eca6e tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-40a35e1e-fc53-471c-bebd-66e7b092d041-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "cinder-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "cinder-quobyte-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" acquired by "delete_volume" :: waited 0.009s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d09c00-d23a-4589-b871-511584840cbf]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:22 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea Apr 21 21:03:22 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:22 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" returned: 0 in 0.556s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:22 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:22 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea Apr 21 21:03:22 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:23 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" returned: 0 in 0.472s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea" released by "delete_volume" :: held 1.069s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Created reservations ['cd6c2558-7342-469a-bc34-6fb29ba49985', 'f32addf3-69c3-480d-b85d-8d0e773118d4', '4be6f581-2328-439e-98d9-83bd5491d7f3', 'bbe8582d-aa5f-4dc5-bb3a-b9437cc9ae58'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:23 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:23 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:23 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.400s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:23 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Deleted volume successfully. Apr 21 21:03:23 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-16d7dcfd-5585-4c45-802f-83d3c45ac501 tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-4ab3f632-dc2c-48b1-9d04-a869ff03f1ea-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "cinder-39b5aadf-4d75-4faf-979d-30e45539ed3e-delete_volume" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-39b5aadf-4d75-4faf-979d-30e45539ed3e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "cinder-quobyte-39b5aadf-4d75-4faf-979d-30e45539ed3e" by "delete_volume" {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-39b5aadf-4d75-4faf-979d-30e45539ed3e" acquired by "delete_volume" :: waited 0.007s {{(pid=82362) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d845c2-c05c-424d-a940-876a1a050cbf]: (4, 'qcow2') {{(pid=83359) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:24 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e Apr 21 21:03:24 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:24 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e" returned: 0 in 0.460s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:24 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:24 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e Apr 21 21:03:24 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:25 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651/volume-39b5aadf-4d75-4faf-979d-30e45539ed3e" returned: 0 in 0.413s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-quobyte-39b5aadf-4d75-4faf-979d-30e45539ed3e" released by "delete_volume" :: held 0.898s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG cinder.quota [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Created reservations ['a80db783-62a4-4806-ae37-6702eb74bd2e', '75674999-3acc-473d-b478-6a61abd5f61b', '084c9ad4-6222-4375-93ed-9cd761e98fce', '95746eb6-e35b-4242-95a8-0faa062b7bb2'] {{(pid=82362) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3': None} {{(pid=82362) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG cinder.volume.drivers.quobyte [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d532592-036f-478d-a5e0-ad8f0dccf9b3'] {{(pid=82362) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.lockutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82362) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:03:25 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651 Apr 21 21:03:25 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:03:25 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG oslo_concurrency.processutils [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/33e9dd820477a9a3ffd4eaf5b47c1651" returned: 0 in 0.444s {{(pid=82362) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG cinder.manager [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Notifying Schedulers of capabilities ... {{(pid=82362) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:03:25 devstack cinder-volume[82362]: INFO cinder.volume.manager [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Deleted volume successfully. Apr 21 21:03:25 devstack cinder-volume[82362]: DEBUG cinder.coordination [None req-35fcd8b0-a63c-4cfe-9971-c277dcc4732b tempest-CinderUnicodeTest-1152892299 None] Lock "cinder-39b5aadf-4d75-4faf-979d-30e45539ed3e-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=82362) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:03:35 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=166,cinder:INSERT=59,cinder:UPDATE=259,cinder:DELETE=20 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:03:35 devstack cinder-volume[82362]: DEBUG dbcounter [-] [82362] Writing DB stats cinder:SELECT=166,cinder:INSERT=61,cinder:DELETE=21,cinder:UPDATE=227 {{(pid=82362) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}